-- Logs begin at Sun 2022-10-16 00:10:46 UTC, end at Sun 2022-10-16 01:19:00 UTC. -- Oct 16 00:47:07.867131 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 16 00:47:07.876372 dv-cinder-master-3-smb devstack@n-api.service[103737]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:47:07 2022] *** Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: nodename: dv-cinder-master-3-smb Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: machine: x86_64 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: clock source: unix Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: pcre jit disabled Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: detected number of CPU cores: 4 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: current working directory: / Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: your processes number limit is 47680 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: your memory page size is 4096 bytes Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: detected max file descriptor number: 2048 Oct 16 00:47:07.878415 dv-cinder-master-3-smb devstack@n-api.service[103737]: lock engine: pthread robust mutexes Oct 16 00:47:07.879439 dv-cinder-master-3-smb devstack@n-api.service[103737]: thunder lock: enabled Oct 16 00:47:07.879439 dv-cinder-master-3-smb devstack@n-api.service[103737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 16 00:47:07.879439 dv-cinder-master-3-smb devstack@n-api.service[103737]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:47:07.917402 dv-cinder-master-3-smb devstack@n-api.service[103737]: Python main interpreter initialized at 0x563b266c59c0 Oct 16 00:47:07.917402 dv-cinder-master-3-smb devstack@n-api.service[103737]: python threads support enabled Oct 16 00:47:07.917402 dv-cinder-master-3-smb devstack@n-api.service[103737]: your server socket listen backlog is limited to 100 connections Oct 16 00:47:07.917402 dv-cinder-master-3-smb devstack@n-api.service[103737]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:47:07.917743 dv-cinder-master-3-smb devstack@n-api.service[103737]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:47:07.917823 dv-cinder-master-3-smb devstack@n-api.service[103737]: *** Operational MODE: preforking *** Oct 16 00:47:07.918061 dv-cinder-master-3-smb devstack@n-api.service[103737]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:47:07.918061 dv-cinder-master-3-smb devstack@n-api.service[103737]: spawned uWSGI master process (pid: 103737) Oct 16 00:47:07.919336 dv-cinder-master-3-smb devstack@n-api.service[103737]: spawned uWSGI worker 1 (pid: 103738, cores: 1) Oct 16 00:47:07.919336 dv-cinder-master-3-smb devstack@n-api.service[103737]: spawned uWSGI worker 2 (pid: 103739, cores: 1) Oct 16 00:47:07.919336 dv-cinder-master-3-smb devstack@n-api.service[103737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:47:07.918254 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 16 00:47:08.564528 dv-cinder-master-3-smb devstack@n-api.service[103738]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:47:08.570113 dv-cinder-master-3-smb devstack@n-api.service[103739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:47:09.619064 dv-cinder-master-3-smb devstack@n-api.service[103738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:47:09.619064 dv-cinder-master-3-smb devstack@n-api.service[103738]: from cryptography.utils import int_from_bytes Oct 16 00:47:09.619666 dv-cinder-master-3-smb devstack@n-api.service[103739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:47:09.619666 dv-cinder-master-3-smb devstack@n-api.service[103739]: from cryptography.utils import int_from_bytes Oct 16 00:47:09.620070 dv-cinder-master-3-smb devstack@n-api.service[103738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:47:09.620070 dv-cinder-master-3-smb devstack@n-api.service[103738]: from cryptography.utils import int_from_bytes Oct 16 00:47:09.620182 dv-cinder-master-3-smb devstack@n-api.service[103739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:47:09.620182 dv-cinder-master-3-smb devstack@n-api.service[103739]: from cryptography.utils import int_from_bytes Oct 16 00:47:12.051711 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:47:12.052315 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:47:12.052674 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:47:12.052765 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:47:12.052866 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:47:12.052946 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:47:12.053024 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:47:12.053093 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:47:12.053168 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:47:12.053235 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:47:12.053449 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.053614 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.053770 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.053876 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054067 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054212 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054379 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054522 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054705 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.054851 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055008 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055145 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055294 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055399 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055632 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055774 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.055950 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056104 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056192 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056282 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056485 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056584 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056786 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.056908 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057120 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057226 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057415 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057518 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057713 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.057813 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058012 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058115 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058307 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058405 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058612 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058763 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.058894 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.059039 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.059375 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.059480 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.059795 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.059903 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060088 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060257 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060396 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060538 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060676 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.060956 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061041 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061126 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061292 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061385 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061598 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061703 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061895 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.061980 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062204 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062289 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062500 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062598 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062883 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.062982 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063191 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063287 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063489 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063572 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063784 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.063872 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064182 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064333 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064482 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064630 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064779 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.064888 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065116 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065209 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065425 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065519 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065720 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.065808 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066033 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066119 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066341 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066428 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066650 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066736 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.066958 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067057 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067248 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067333 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067611 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067709 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.067913 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068009 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068220 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068305 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068511 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068598 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068805 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.068924 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069071 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069201 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069376 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069482 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069684 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069789 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.069994 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070104 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070299 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070396 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070542 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070646 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070781 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.070868 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071088 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071228 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071400 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071498 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071698 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071782 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.071993 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072098 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072288 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072374 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072581 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072667 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072896 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.072999 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073191 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073277 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073486 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073570 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073780 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.073866 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074084 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074171 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074386 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074471 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074693 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074836 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.074988 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075073 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075292 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075377 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075672 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075760 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.075913 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076011 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076207 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076294 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076532 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076618 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.076851 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077013 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077153 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077273 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077460 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077562 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077766 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.077858 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078060 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078163 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078352 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078464 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078643 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.078725 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081498 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081631 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081631 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081764 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081831 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081908 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.081975 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082053 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082053 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082170 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082234 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082297 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082380 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082448 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082518 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082583 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082653 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082718 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082789 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082855 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.082926 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083047 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083136 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083213 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083287 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083353 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083417 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083480 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083544 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083613 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083693 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083760 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083830 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083922 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.083988 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084051 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084132 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084198 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084465 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084564 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084632 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084706 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.084979 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085076 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085245 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085338 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085561 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085705 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085878 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.085977 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086131 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086227 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086428 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086554 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086745 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.086838 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087009 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087098 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087312 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087407 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087562 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087630 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.087885 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.088010 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.088173 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.088317 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.088952 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089040 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089118 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089194 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089280 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089358 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089433 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089508 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089574 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089663 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.089895 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090032 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090167 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090254 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090485 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090616 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090820 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.090955 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091039 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091116 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091349 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091499 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091586 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091663 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.091903 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092093 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092249 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092395 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092525 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092653 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092789 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.092905 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093060 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093211 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093333 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093427 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093681 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093819 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093904 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.093993 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.094223 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.094357 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.094526 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.094658 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:47:12.094847 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.094993 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095159 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095270 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095479 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095614 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095769 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.095861 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096088 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096177 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096405 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096494 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096711 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.096811 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097037 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097129 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097354 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097498 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097649 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097738 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.097948 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098044 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098247 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098347 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098550 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098699 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.098911 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099029 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099225 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099321 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099545 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099634 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099848 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.099936 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100138 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100283 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100443 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100531 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100738 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.100824 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101079 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101192 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101386 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101483 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101695 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101787 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.101995 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102108 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102328 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102424 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102660 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102745 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.102963 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103056 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103278 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103369 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103592 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103679 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103897 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.103988 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.104196 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.104279 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.104873 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105029 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105207 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105349 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105508 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105644 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105810 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.105953 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106116 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106248 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106417 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106549 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106728 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.106857 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107029 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107161 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107327 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107460 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107627 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107765 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.107925 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108052 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108223 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108365 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108546 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108699 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108861 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.108991 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109173 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109315 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109480 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109702 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109857 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.109994 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110125 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110343 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110443 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110531 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110647 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110732 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.110944 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111029 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111237 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111339 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111531 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111615 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111823 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.111908 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112120 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112205 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112416 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112502 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112720 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.112804 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113061 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113155 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113362 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113448 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113684 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113768 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.113981 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114065 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114303 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114392 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114601 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114715 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114901 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.114988 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115197 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115281 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115496 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115588 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115794 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.115884 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116089 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116175 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116401 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116494 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116699 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.116785 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117019 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117104 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117331 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117427 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117629 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117725 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.117923 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118007 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118229 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118323 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118526 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118623 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118824 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.118915 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119124 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119210 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119419 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119505 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119731 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.119822 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120029 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120113 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120398 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120495 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120646 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120731 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.120998 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121088 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121293 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121376 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121605 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121690 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.121919 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122004 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122229 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122315 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122522 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122615 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122829 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.122922 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123111 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123203 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123402 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123494 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123692 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123776 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.123989 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124072 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124280 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124372 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124572 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124656 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124881 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.124981 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125178 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125271 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125469 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125560 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125779 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.125862 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126072 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126167 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126362 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126446 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126653 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126737 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.126944 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127029 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127271 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127355 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127566 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127652 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127896 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.127988 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128219 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128302 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128527 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128610 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128871 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.128959 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129168 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129260 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129472 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129564 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129771 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.129863 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130141 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130227 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130516 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130623 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130746 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.130831 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131058 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131142 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131361 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131454 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131671 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131754 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.131967 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132052 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132280 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132373 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132581 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132664 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132910 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.132997 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133208 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133303 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133514 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133607 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133840 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.133932 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134163 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134247 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134460 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134547 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134772 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.134856 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135070 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135156 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135372 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135457 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135672 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135760 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.135968 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136060 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136264 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136350 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136562 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136646 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136885 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.136976 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137189 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137276 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137499 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137661 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137794 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.137933 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138104 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138196 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138401 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138493 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138703 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138789 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.138999 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139084 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139298 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139391 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139614 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139699 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.139934 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140018 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140230 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140323 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140530 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140667 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140863 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.140949 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141166 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141252 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141464 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141547 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141765 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.141858 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142056 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142151 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142354 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142445 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142650 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142741 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.142955 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143039 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143251 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143335 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143551 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143636 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143845 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.143929 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144146 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144229 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144444 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144536 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144736 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.144820 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145057 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145140 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145358 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145457 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145722 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.145808 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146027 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146113 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146345 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146438 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146658 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146754 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.146952 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147035 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147248 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147339 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147562 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147660 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147861 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.147944 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148153 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148245 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148447 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148531 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148738 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.148830 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149096 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149181 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149394 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149477 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149690 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149776 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.149994 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150079 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150300 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150385 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150601 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150684 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150903 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.150990 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151202 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151288 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151499 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151593 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151812 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.151904 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152112 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152196 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152409 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152501 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152709 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.152814 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153035 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153120 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153336 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153430 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153636 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153724 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.153950 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154034 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154247 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154343 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154547 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154639 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154843 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.154928 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155137 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155231 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155436 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155533 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155741 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.155832 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.156306 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.156391 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.156630 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.156713 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.156965 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157053 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157277 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157363 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157611 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157706 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.157921 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158014 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158243 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158343 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158560 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158655 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158866 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.158949 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159161 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159245 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159461 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159547 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159756 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.159853 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160050 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160141 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160349 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160482 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160642 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160767 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.160991 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161155 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161365 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161495 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161629 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161756 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.161882 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162006 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162144 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162271 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162400 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162543 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162699 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.162836 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163004 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163130 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163297 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163424 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163597 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163733 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.163891 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164020 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164202 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164331 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164500 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164640 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164797 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.164989 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165121 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165257 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165387 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165526 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165712 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.165847 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166006 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166133 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166332 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166476 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166652 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166783 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.166981 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167112 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167280 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167411 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167571 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167702 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.167886 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168016 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168183 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168322 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168477 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168616 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168770 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.168933 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169106 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169243 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169387 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169522 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169672 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169807 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.169968 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170099 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170268 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170401 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170564 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170703 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170843 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.170981 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171139 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171226 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171436 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171528 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171727 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.171819 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172032 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172116 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172334 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172420 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172626 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172709 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.172943 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173032 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173246 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173332 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173543 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173638 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173836 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.173920 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174132 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174216 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174423 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174507 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174732 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.174816 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175029 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175113 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175320 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175404 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175615 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175697 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.175912 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176006 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176209 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176292 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176499 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176592 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176878 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.176979 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177190 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177320 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177491 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177585 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177787 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.177874 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178084 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178170 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178379 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178519 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178652 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178782 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.178950 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179083 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179260 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179401 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179565 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179707 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179851 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.179984 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180145 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180278 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180441 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180571 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180730 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.180886 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181051 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181199 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181352 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181478 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181640 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181783 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.181925 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182055 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182214 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182346 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182504 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182639 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182797 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.182929 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183108 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183243 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183404 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183549 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183695 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183824 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.183977 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184115 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184270 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184410 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184596 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184725 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.184911 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185041 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185261 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185405 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185549 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185680 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185845 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.185977 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186153 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186294 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186456 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186587 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186754 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.186887 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187058 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187197 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187355 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187505 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187659 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187790 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.187961 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188050 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188265 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188348 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188559 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188645 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188888 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.188992 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189187 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189272 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189489 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189573 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189789 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.189874 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190101 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190184 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190414 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190506 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190727 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.190818 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191020 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191112 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191318 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191468 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191608 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191737 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.191897 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192030 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192200 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192340 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192520 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192659 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192822 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.192997 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193138 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193272 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193413 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193583 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193715 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.193888 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194023 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194192 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194326 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194490 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194621 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194797 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.194938 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195096 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195239 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195397 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195525 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195704 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195843 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.195981 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196110 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196277 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196409 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196571 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196710 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.196891 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197019 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197162 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197289 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197462 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197593 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197862 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.197992 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198162 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198246 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198456 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198583 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198752 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.198835 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199051 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199135 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199354 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199446 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199656 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199739 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.199949 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200033 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200247 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200353 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200653 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200748 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.200979 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201083 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201278 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201411 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201576 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201660 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201868 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.201960 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202163 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202248 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202466 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202552 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202756 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.202847 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203051 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203135 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203343 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203427 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203638 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203734 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.203931 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204014 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204237 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204327 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204550 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204645 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.204945 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205032 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205243 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205328 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205562 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205647 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.205933 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206023 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206233 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206317 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206545 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206644 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206851 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.206936 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207164 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207248 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207459 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207545 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207759 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.207844 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208115 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208203 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208418 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208503 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208736 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.208830 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209069 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209153 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209372 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209456 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209668 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209760 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.209961 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210045 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210275 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210369 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210576 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210661 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210882 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.210976 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211196 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211289 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211581 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211665 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211882 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.211969 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212191 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212283 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212503 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212594 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212800 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.212923 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213125 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213211 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213422 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213507 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213717 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.213801 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214011 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214095 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214307 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214391 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214602 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214686 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.214902 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215035 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215202 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215288 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215501 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215585 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215794 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.215880 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216087 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216179 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216383 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216474 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216679 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.216762 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217001 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217086 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217306 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217399 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217613 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217696 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.217919 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218004 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218215 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218309 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218514 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218598 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218813 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.218905 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219106 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219201 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219402 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219494 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219694 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219779 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.219991 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220076 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220306 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220391 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220610 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220693 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.220950 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221084 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221272 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221356 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221577 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221662 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221889 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.221974 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222214 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222297 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222526 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222618 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222826 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.222911 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223127 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223211 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223437 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223530 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223754 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.223840 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224051 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224148 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224348 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224442 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224643 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224738 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.224959 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225046 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225256 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225352 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225551 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225635 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225841 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.225925 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226132 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226230 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226423 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226508 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226717 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.226801 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227015 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227108 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227319 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227403 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227617 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227710 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.227915 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228000 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228214 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228297 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228503 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228586 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228799 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.228912 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.229137 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.229221 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.229447 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.229908 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230116 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230202 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230430 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230516 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230738 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.230831 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231046 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231176 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231353 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231439 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231659 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231753 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.231967 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232060 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232275 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232360 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232582 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232675 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.232973 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233061 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233279 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233363 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233584 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233685 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233892 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.233975 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.234203 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.234393 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.234713 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.234799 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235016 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235100 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235317 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235401 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235621 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235706 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.235922 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236016 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236226 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236320 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236528 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236613 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236829 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.236965 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237150 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237245 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237451 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237537 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237751 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.237835 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238069 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238161 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238382 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238468 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238700 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.238794 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239007 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239099 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239360 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239448 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239668 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239760 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.239972 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240059 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240277 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240360 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240616 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240701 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.240939 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241028 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241245 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241330 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241549 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241646 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241854 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.241947 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242160 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242252 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242459 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242553 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242760 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.242853 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243061 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243146 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243360 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243454 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243656 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243741 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.243956 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244041 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244258 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244343 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244564 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244656 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.244917 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245004 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245215 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245303 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245516 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245601 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245817 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.245903 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.246122 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.246215 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.246429 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.246625 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.246929 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247021 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247232 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247317 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247551 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247635 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247865 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.247957 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248170 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248254 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248475 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248562 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248787 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.248900 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249111 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249202 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249408 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249493 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249705 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.249798 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250000 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250084 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250296 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250381 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250591 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250675 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250894 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.250979 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251185 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251270 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251481 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251572 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251779 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.251919 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.252080 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.252297 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.252602 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.252688 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.252950 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253039 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253268 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253352 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253584 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253670 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253891 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.253982 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254188 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254285 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254490 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254575 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254789 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.254895 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255114 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255207 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255411 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255495 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255708 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.255793 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256004 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256167 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256298 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256390 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256593 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256683 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.256912 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257024 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257212 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257297 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257508 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257591 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257799 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.257892 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258093 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258177 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258403 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258486 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258699 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258785 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.258994 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259080 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259292 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259384 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259583 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259668 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259879 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.259964 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260173 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260256 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260467 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260559 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260762 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.260891 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261087 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261183 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261383 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261474 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261678 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261761 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.261975 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262071 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262280 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262372 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262605 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262689 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262901 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.262996 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263201 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263284 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263496 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263579 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263791 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.263884 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264088 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264172 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264389 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264475 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264698 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.264790 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265023 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265108 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265325 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265410 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265662 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265749 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.265967 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.266051 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.266310 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.266481 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.266805 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.266891 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267116 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267203 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267436 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267522 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267758 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.267850 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268057 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268142 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268353 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268447 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268649 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268734 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.268975 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269063 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269273 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269424 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269575 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269661 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269874 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.269958 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270175 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270267 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270473 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270600 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270823 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.270909 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271124 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271210 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271421 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271504 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271721 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.271863 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272020 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272106 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272318 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272402 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272619 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272703 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.272940 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273026 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273244 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273336 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273545 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273642 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273852 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.273936 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274174 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274265 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274485 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274578 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274790 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.274874 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275097 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275187 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275397 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275492 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275698 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275784 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.275998 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276089 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276297 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276394 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276597 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276689 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.276932 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277020 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277237 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277322 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277532 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277616 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.277835 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.278179 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.278484 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.278614 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.278789 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.278882 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279100 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279191 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279403 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279493 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279705 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.279789 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280018 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280115 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280320 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280407 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280622 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280723 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.280945 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281044 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281255 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281339 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281578 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281714 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281897 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.281995 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282216 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282306 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282511 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282596 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282812 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.282897 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283109 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283193 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283407 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283501 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283707 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.283800 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284006 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284098 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284300 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284385 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284594 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284683 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.284915 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285005 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285210 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285309 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285506 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285633 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285797 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.285882 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286091 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286209 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286410 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286496 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286703 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286789 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.286998 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287090 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287289 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287373 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287582 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287667 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287876 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.287968 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288167 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288252 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288462 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288553 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288751 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.288854 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289068 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289154 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289358 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289442 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289651 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289736 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.289939 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290030 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290232 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290317 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290557 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290643 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290858 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.290949 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291172 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291256 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291473 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291560 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291774 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.291858 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292073 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292165 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292375 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292468 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292682 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.292767 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293011 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293110 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293312 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293440 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293611 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293695 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.293922 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294014 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294221 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294306 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294522 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294608 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294822 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.294920 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295117 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295202 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295413 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295498 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295711 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.295795 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296027 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296111 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296323 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296407 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296625 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296753 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.296957 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297045 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297271 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297354 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297573 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297667 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297874 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.297959 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298175 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298271 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298474 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298559 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298775 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.298861 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299072 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299165 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299372 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299455 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299667 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299753 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.299967 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300059 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300264 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300350 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300563 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300655 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300888 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.300976 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.301192 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.301276 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.301497 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.301580 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.301918 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302013 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302191 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302331 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302492 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302596 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302813 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.302907 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303132 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303217 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303430 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303514 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303763 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.303849 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304080 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304166 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304385 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304480 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304686 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.304772 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.305016 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.305103 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.305252 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:47:12.305352 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:47:12.305544 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:47:12.460429 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO dbcounter [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Registered counter for database nova_api Oct 16 00:47:12.460804 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO dbcounter [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Registered counter for database nova_api Oct 16 00:47:12.482682 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_db.sqlalchemy.engines [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.484420 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.489930 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writer thread running {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.491673 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writer thread running {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.545710 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.context [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=103738) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:47:12.546264 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.context [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=103739) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:47:12.549703 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:47:12.550144 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:47:12.550634 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:47:12.551090 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:47:12.551746 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:47:12.552522 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:47:12.552650 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:47:12.552889 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:47:12.553410 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:47:12.553839 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:47:12.554903 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:47:12.555817 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_concurrency.lockutils [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:47:12.556905 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO dbcounter [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Registered counter for database nova_cell0 Oct 16 00:47:12.557821 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO dbcounter [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Registered counter for database nova_cell0 Oct 16 00:47:12.560942 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO dbcounter [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Registered counter for database nova_cell1 Oct 16 00:47:12.561795 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO dbcounter [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Registered counter for database nova_cell1 Oct 16 00:47:12.572268 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.572526 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_db.sqlalchemy.engines [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.573602 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_db.sqlalchemy.engines [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.575248 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.580137 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writer thread running {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.580933 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writer thread running {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.582360 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writer thread running {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.717358 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writer thread running {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.723797 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO dbcounter [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Registered counter for database nova_cell0 Oct 16 00:47:12.727586 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO dbcounter [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Registered counter for database nova_cell0 Oct 16 00:47:12.733515 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_db.sqlalchemy.engines [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.737181 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:47:12.738992 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writer thread running {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:12.741733 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writer thread running {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:47:13.074027 dv-cinder-master-3-smb devstack@n-api.service[103739]: WARNING keystonemiddleware.auth_token [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:47:13.074892 dv-cinder-master-3-smb devstack@n-api.service[103738]: WARNING keystonemiddleware.auth_token [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:47:13.081410 dv-cinder-master-3-smb devstack@n-api.service[103739]: WARNING keystonemiddleware.auth_token [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:47:13.082142 dv-cinder-master-3-smb devstack@n-api.service[103738]: WARNING keystonemiddleware.auth_token [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:47:13.421960 dv-cinder-master-3-smb devstack@n-api.service[103739]: WARNING keystonemiddleware.auth_token [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:47:13.423684 dv-cinder-master-3-smb devstack@n-api.service[103738]: WARNING keystonemiddleware.auth_token [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:47:13.427869 dv-cinder-master-3-smb devstack@n-api.service[103739]: WARNING keystonemiddleware.auth_token [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:47:13.429681 dv-cinder-master-3-smb devstack@n-api.service[103738]: WARNING keystonemiddleware.auth_token [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:47:13.433150 dv-cinder-master-3-smb devstack@n-api.service[103739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b266c59c0 pid: 103739 (default app) Oct 16 00:47:13.435082 dv-cinder-master-3-smb devstack@n-api.service[103738]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b266c59c0 pid: 103738 (default app) Oct 16 00:47:13.435224 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:47:13.436389 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-c7a6c21e-8f73-40ec-a1d3-117ab8a928bd None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Oct 16 00:47:13.436791 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sun Oct 16 00:47:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:34.215866 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:34.217026 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Oct 16 00:48:34.217387 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:48:34.229355 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_api:SELECT=3 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:34.230384 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_cell1:SELECT=3 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:34.232996 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_cell0:SELECT=3 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:34.234067 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:35.081175 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-9d6fdaed-0c16-466e-9aa6-40d6fbf1c950 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:35.112135 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-9d6fdaed-0c16-466e-9aa6-40d6fbf1c950 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.888364 Oct 16 00:48:35.113014 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 16 00:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:37.735512 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:37.736471 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-743f1637-d05a-42f2-99af-d39c589a9a58 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 16 00:48:37.737183 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:38.177638 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-3201cb46-5a86-4bb2-ab74-5f0e32041979 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:38.225662 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-3201cb46-5a86-4bb2-ab74-5f0e32041979 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482064 Oct 16 00:48:38.226225 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:38.240364 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_api:SELECT=3 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.241295 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_cell1:SELECT=3 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.243293 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_cell0:SELECT=3 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.244389 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.446890 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-00e895d6-5a0e-4135-a44f-6de9079b25df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:38.512023 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-00e895d6-5a0e-4135-a44f-6de9079b25df admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276927 Oct 16 00:48:38.512926 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 16 00:48:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:41.084958 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-3201cb46-5a86-4bb2-ab74-5f0e32041979 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:41.086525 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-3201cb46-5a86-4bb2-ab74-5f0e32041979 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Oct 16 00:48:41.088246 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:41.731108 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-503d3c9b-3c3c-4f87-b4f8-f7e57a66155c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:41.771011 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-503d3c9b-3c3c-4f87-b4f8-f7e57a66155c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677086 Oct 16 00:48:41.771906 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:48:41.784410 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-29662857-60f9-4a7e-a411-51bb192fc9ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:41.829499 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-29662857-60f9-4a7e-a411-51bb192fc9ef admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049226 Oct 16 00:48:41.832878 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 16 00:48:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:44.399503 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-503d3c9b-3c3c-4f87-b4f8-f7e57a66155c admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:44.400521 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-503d3c9b-3c3c-4f87-b4f8-f7e57a66155c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 16 00:48:44.400979 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:44.813533 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-f0956025-493f-485c-8b76-bbb52dcac001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d2"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:44.833204 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-f0956025-493f-485c-8b76-bbb52dcac001 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425510 Oct 16 00:48:44.833767 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:44.846098 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-0127877c-1ba3-4858-81ae-c58d56145648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:44.875582 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-0127877c-1ba3-4858-81ae-c58d56145648 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033343 Oct 16 00:48:44.876269 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 16 00:48:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:47.471732 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-f0956025-493f-485c-8b76-bbb52dcac001 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:47.473025 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-f0956025-493f-485c-8b76-bbb52dcac001 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Oct 16 00:48:47.473754 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:47.873560 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-ba108c42-6b86-476d-bf76-3294e83b3644 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:47.893830 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-ba108c42-6b86-476d-bf76-3294e83b3644 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413521 Oct 16 00:48:47.894727 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:48:47.907310 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-94459407-8fab-4812-9f6b-417ee3bd8da5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:47.938195 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-94459407-8fab-4812-9f6b-417ee3bd8da5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035137 Oct 16 00:48:47.946762 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 16 00:48:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:50.560462 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-ba108c42-6b86-476d-bf76-3294e83b3644 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:50.561435 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-ba108c42-6b86-476d-bf76-3294e83b3644 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Oct 16 00:48:50.561844 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:51.006271 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "id": "d4"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:51.029473 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461207 Oct 16 00:48:51.030497 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:51.047004 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-b30e09fd-22f1-461e-9a91-88a360649855 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:51.074382 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-b30e09fd-22f1-461e-9a91-88a360649855 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031358 Oct 16 00:48:51.074989 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1336 bytes} [Sun Oct 16 00:48:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:48:53.881124 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:53.882410 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Oct 16 00:48:53.882815 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:48:54.307819 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-5e483089-defc-4463-adec-cdce4bfe732c admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:54.333665 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-5e483089-defc-4463-adec-cdce4bfe732c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443284 Oct 16 00:48:54.334523 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 16 00:48:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:48:56.994848 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:48:56.996535 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-8eac8ea3-619a-494e-bffb-50cc95727d96 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Oct 16 00:48:56.997129 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:48:57.458453 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-d37378de-ed26-426c-b781-d0cb704bfd0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:57.479715 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-d37378de-ed26-426c-b781-d0cb704bfd0a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474924 Oct 16 00:48:57.480277 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:48:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:48:57.495578 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-353e4afd-7044-47dd-b8cc-fb7094ea15fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:48:57.530167 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-353e4afd-7044-47dd-b8cc-fb7094ea15fe admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039109 Oct 16 00:48:57.530914 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 16 00:48:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:49:00.139235 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-d37378de-ed26-426c-b781-d0cb704bfd0a admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:00.140177 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-d37378de-ed26-426c-b781-d0cb704bfd0a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 16 00:49:00.140583 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:00.550236 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-c15f1b76-c7f7-416f-897f-9bb28c72e350 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:00.570175 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-c15f1b76-c7f7-416f-897f-9bb28c72e350 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423121 Oct 16 00:49:00.570728 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:49:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:00.583110 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-679b78f5-04d3-48eb-94ba-c6918dc1f1ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:00.608203 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-679b78f5-04d3-48eb-94ba-c6918dc1f1ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028923 Oct 16 00:49:00.608693 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 16 00:49:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:49:03.201255 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-c15f1b76-c7f7-416f-897f-9bb28c72e350 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:03.202935 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-c15f1b76-c7f7-416f-897f-9bb28c72e350 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Oct 16 00:49:03.203629 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:49:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:03.634927 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-b46b90e3-7dba-4bf2-a8a4-74e58bc27832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:03.656895 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-b46b90e3-7dba-4bf2-a8a4-74e58bc27832 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.447173 Oct 16 00:49:03.657451 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:49:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:03.672264 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-6dd9535b-832c-4a20-9546-1bd3a78887a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:03.700532 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-6dd9535b-832c-4a20-9546-1bd3a78887a0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034647 Oct 16 00:49:03.701600 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 16 00:49:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:49:06.336694 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-b46b90e3-7dba-4bf2-a8a4-74e58bc27832 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:06.337738 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-b46b90e3-7dba-4bf2-a8a4-74e58bc27832 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Oct 16 00:49:06.338139 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:49:06.763875 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-79223ee1-de33-4a9b-94db-f0fabf368429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:06.769564 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:06.787631 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-79223ee1-de33-4a9b-94db-f0fabf368429 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443468 Oct 16 00:49:06.788362 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:49:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:49:06.800629 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-388f51fb-2f27-4e37-a587-43ec81ea56bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:06.827542 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-388f51fb-2f27-4e37-a587-43ec81ea56bf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030654 Oct 16 00:49:06.828479 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 16 00:49:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:49:09.398873 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-79223ee1-de33-4a9b-94db-f0fabf368429 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:09.399922 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-79223ee1-de33-4a9b-94db-f0fabf368429 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 16 00:49:09.400334 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:09.840267 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:09.848445 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:09.881358 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471618 Oct 16 00:49:09.881358 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1283 bytes} [Sun Oct 16 00:49:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:09.891832 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-eaf6642c-6d63-4324-a979-3edaa47c43ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:09.948971 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-eaf6642c-6d63-4324-a979-3edaa47c43ed admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053614 Oct 16 00:49:09.948971 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1333 bytes} [Sun Oct 16 00:49:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:49:28.275941 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:28.277500 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002400 Oct 16 00:49:28.278158 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:28.289232 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:28.757161 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-ae8dd83e-8bc5-4fd1-b268-516c9d388829 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:28.775778 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-ae8dd83e-8bc5-4fd1-b268-516c9d388829 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.491092 Oct 16 00:49:28.776332 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 16 00:49:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:30.110300 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:30.111301 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-ecb965ae-12f9-48b2-bfd3-c10d6800ca2a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 16 00:49:30.111735 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:30.656434 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b25e5eb7-187d-4638-b8c9-0050379d06ec admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:30.662074 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.wsgi [None req-b25e5eb7-187d-4638-b8c9-0050379d06ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b25e5eb7-187d-4638-b8c9-0050379d06ec admin admin] Request method failure captured: Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept: application/json Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept-Encoding: gzip, deflate Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Connection: keep-alive Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Content-Length: 0 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Host: 10.222.0.13 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-System-Scope: None Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: User-Agent: python-novaclient Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Auth-Token: gAAAAABjS1UaJB9r3sffAXiyVueB3RO9_AzF7K_wK_C0GtxtXA6CFfKvJD-L9EPCxSZVOa-DA663s5TO4vvepwv-RhJR3CMPU3HTTmbPqZrJIusOb6iRe7EMp0Dmu32aezILw-2Vj2YE7KHp1cD2O6DEDtN0usX3mo2a7MmwaocmJSaU0T17ZDw Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Id: None Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Name: None Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Identity-Status: Confirmed Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Is-Admin-Project: True Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Id: default Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Name: Default Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Name: admin Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Role: member,reader,admin Oct 16 00:49:30.665344 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Roles: member,reader,admin Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant: admin Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Name: admin Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User: admin Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Id: default Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Name: Default Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Name: admin Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: method: > Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: exception: Flavor 42 could not be found. Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: action_args: {'id': '42'} Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:30.666923 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:30.668043 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.669595 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b25e5eb7-187d-4638-b8c9-0050379d06ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:30.670968 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b25e5eb7-187d-4638-b8c9-0050379d06ec admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.418859 Oct 16 00:49:30.670968 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 16 00:49:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:30.676805 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-718ef65e-1ea4-4fa2-b790-ea59dcb55c57 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:30.700093 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-718ef65e-1ea4-4fa2-b790-ea59dcb55c57 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026781 Oct 16 00:49:30.700635 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:49:30.711895 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-5b0b687e-8101-4b72-b4bd-3b5dbd023286 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:30.734339 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-5b0b687e-8101-4b72-b4bd-3b5dbd023286 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027164 Oct 16 00:49:30.734887 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:30.744508 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-22aa6fc8-691a-4b1e-a734-b3b743a7118a admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:30.750863 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.wsgi [None req-22aa6fc8-691a-4b1e-a734-b3b743a7118a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-22aa6fc8-691a-4b1e-a734-b3b743a7118a admin admin] Request method failure captured: Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept: application/json Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept-Encoding: gzip, deflate Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Connection: keep-alive Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Content-Length: 0 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Host: 10.222.0.13 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-System-Scope: None Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: User-Agent: python-novaclient Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Auth-Token: gAAAAABjS1UaJB9r3sffAXiyVueB3RO9_AzF7K_wK_C0GtxtXA6CFfKvJD-L9EPCxSZVOa-DA663s5TO4vvepwv-RhJR3CMPU3HTTmbPqZrJIusOb6iRe7EMp0Dmu32aezILw-2Vj2YE7KHp1cD2O6DEDtN0usX3mo2a7MmwaocmJSaU0T17ZDw Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Id: None Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Name: None Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Identity-Status: Confirmed Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Is-Admin-Project: True Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Id: default Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Name: Default Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Name: admin Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Role: member,reader,admin Oct 16 00:49:30.754200 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Roles: member,reader,admin Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant: admin Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Name: admin Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User: admin Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Id: default Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Name: Default Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Name: admin Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: method: > Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: exception: Flavor 42 could not be found. Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: action_args: {'id': '42'} Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:30.755712 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:30.756729 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:30.757926 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-22aa6fc8-691a-4b1e-a734-b3b743a7118a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:30.759014 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-22aa6fc8-691a-4b1e-a734-b3b743a7118a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014596 Oct 16 00:49:30.759014 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 16 00:49:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:31.973477 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-5b0b687e-8101-4b72-b4bd-3b5dbd023286 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:31.974490 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-5b0b687e-8101-4b72-b4bd-3b5dbd023286 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 16 00:49:31.974868 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:32.511935 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-723732d0-46b8-42ea-939b-5ab9f3421b87 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:32.517156 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.wsgi [None req-723732d0-46b8-42ea-939b-5ab9f3421b87 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-723732d0-46b8-42ea-939b-5ab9f3421b87 admin admin] Request method failure captured: Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept: application/json Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept-Encoding: gzip, deflate Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Connection: keep-alive Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Content-Length: 0 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Host: 10.222.0.13 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-System-Scope: None Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: User-Agent: python-novaclient Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Auth-Token: gAAAAABjS1Ub79G5gxlJTDQIkYSwKN4YICJ6OjoaPNOzq2Nh1d4bmbSCm8YaW3sBBpQ4HlwRWd7p9BohuC5ot1SHJ6NkjI-d-2C5N-n6N9GwuNNvEwAU0Pw36y2LkAd6vUGgkdGiILVOirdZ4Llwy4ApVr0bgeU2lmNnVb-FlXPZI6VdRrItuDA Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Id: None Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Name: None Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Identity-Status: Confirmed Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Is-Admin-Project: True Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Id: default Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Name: Default Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Name: admin Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Role: member,reader,admin Oct 16 00:49:32.518648 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Roles: member,reader,admin Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant: admin Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Name: admin Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User: admin Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Id: default Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Name: Default Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Name: admin Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: method: > Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: exception: Flavor 84 could not be found. Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: action_args: {'id': '84'} Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:32.520095 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:32.521081 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.522345 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-723732d0-46b8-42ea-939b-5ab9f3421b87 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:32.523572 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-723732d0-46b8-42ea-939b-5ab9f3421b87 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409351 Oct 16 00:49:32.523572 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 16 00:49:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:32.530208 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-62a35cac-50f8-4f28-b94d-88a26c4bdaff admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:32.545244 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-62a35cac-50f8-4f28-b94d-88a26c4bdaff admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018710 Oct 16 00:49:32.545803 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:32.555483 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-a6d82336-6a75-47ab-b624-460b9aebc122 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:32.571233 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-a6d82336-6a75-47ab-b624-460b9aebc122 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019315 Oct 16 00:49:32.571787 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:32.581257 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-918ad1c4-2cbf-49cf-b0b7-599ff8785cd0 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:32.586450 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.wsgi [None req-918ad1c4-2cbf-49cf-b0b7-599ff8785cd0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-918ad1c4-2cbf-49cf-b0b7-599ff8785cd0 admin admin] Request method failure captured: Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept: application/json Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept-Encoding: gzip, deflate Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Connection: keep-alive Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Content-Length: 0 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Host: 10.222.0.13 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-System-Scope: None Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: User-Agent: python-novaclient Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Auth-Token: gAAAAABjS1Ub79G5gxlJTDQIkYSwKN4YICJ6OjoaPNOzq2Nh1d4bmbSCm8YaW3sBBpQ4HlwRWd7p9BohuC5ot1SHJ6NkjI-d-2C5N-n6N9GwuNNvEwAU0Pw36y2LkAd6vUGgkdGiILVOirdZ4Llwy4ApVr0bgeU2lmNnVb-FlXPZI6VdRrItuDA Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Id: None Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Name: None Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Identity-Status: Confirmed Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Is-Admin-Project: True Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Id: default Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Name: Default Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Name: admin Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Role: member,reader,admin Oct 16 00:49:32.587992 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Roles: member,reader,admin Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant: admin Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Name: admin Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User: admin Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Id: default Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Name: Default Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Name: admin Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: method: > Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: exception: Flavor 84 could not be found. Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: action_args: {'id': '84'} Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:32.589529 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:32.590382 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:32.591418 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-918ad1c4-2cbf-49cf-b0b7-599ff8785cd0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:32.592470 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-918ad1c4-2cbf-49cf-b0b7-599ff8785cd0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011830 Oct 16 00:49:32.592470 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sun Oct 16 00:49:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:33.800415 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-a6d82336-6a75-47ab-b624-460b9aebc122 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:33.801453 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-a6d82336-6a75-47ab-b624-460b9aebc122 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 16 00:49:33.801849 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:34.348786 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-53ea1910-e486-4b24-adf3-afc00e78632d admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:34.355218 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.wsgi [None req-53ea1910-e486-4b24-adf3-afc00e78632d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-53ea1910-e486-4b24-adf3-afc00e78632d admin admin] Request method failure captured: Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept: application/json Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Accept-Encoding: gzip, deflate Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Connection: keep-alive Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Content-Length: 0 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Host: 10.222.0.13 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: Openstack-System-Scope: None Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: User-Agent: python-novaclient Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Auth-Token: gAAAAABjS1Ud6WFSozDuf5bjE6rQW4UUrarlXRfTdZmeZkIfyDSnWIPzckkFzset1VsuqMsQE32orwDDNDl89bL3UzEWD-9dQvBzNw5lnYTyz58ajhhjF752O5VvPFQzJ4DUmaDGMAnRGDveRquj_XNvthzeXZvQt3K1dWUqChOJg1Wo42r37OU Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Id: None Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Domain-Name: None Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Identity-Status: Confirmed Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Is-Admin-Project: True Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Id: default Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Domain-Name: Default Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Project-Name: admin Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Role: member,reader,admin Oct 16 00:49:34.356728 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Roles: member,reader,admin Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant: admin Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-Tenant-Name: admin Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User: admin Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Id: default Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Domain-Name: Default Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: X-User-Name: admin Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: method: > Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: exception: Flavor 451 could not be found. Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: action_args: {'id': '451'} Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:34.358026 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:34.359069 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.360287 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-53ea1910-e486-4b24-adf3-afc00e78632d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:34.361574 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-53ea1910-e486-4b24-adf3-afc00e78632d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.422018 Oct 16 00:49:34.361574 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:49:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:34.368199 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-6e4d7ca3-aa21-4377-8e1b-3e46e7f647a4 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:34.383250 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-6e4d7ca3-aa21-4377-8e1b-3e46e7f647a4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018778 Oct 16 00:49:34.383782 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:34.393513 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:34.408627 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018785 Oct 16 00:49:34.409175 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sun Oct 16 00:49:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:49:34.418534 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-a79403a7-6512-40de-9286-450fa9545347 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:34.423624 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.wsgi [None req-a79403a7-6512-40de-9286-450fa9545347 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-a79403a7-6512-40de-9286-450fa9545347 admin admin] Request method failure captured: Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept: application/json Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Accept-Encoding: gzip, deflate Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Connection: keep-alive Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Content-Length: 0 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Host: 10.222.0.13 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-Api-Version: compute 2.92 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: Openstack-System-Scope: None Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: User-Agent: python-novaclient Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Auth-Token: gAAAAABjS1Ud6WFSozDuf5bjE6rQW4UUrarlXRfTdZmeZkIfyDSnWIPzckkFzset1VsuqMsQE32orwDDNDl89bL3UzEWD-9dQvBzNw5lnYTyz58ajhhjF752O5VvPFQzJ4DUmaDGMAnRGDveRquj_XNvthzeXZvQt3K1dWUqChOJg1Wo42r37OU Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Id: None Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Domain-Name: None Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Identity-Status: Confirmed Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Is-Admin-Project: True Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Id: default Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Domain-Name: Default Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Project-Name: admin Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Role: member,reader,admin Oct 16 00:49:34.425170 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Roles: member,reader,admin Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76fd6f2e827447f4be188ab2a5fb6b88", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76fd6f2e827447f4be188ab2a5fb6b88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76fd6f2e827447f4be188ab2a5fb6b88"}]}] Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant: admin Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Id: 76fd6f2e827447f4be188ab2a5fb6b88 Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-Tenant-Name: admin Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User: admin Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Id: default Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Domain-Name: Default Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Id: 1cfb0a7e76e5448c9456b4ef4f0b5fd7 Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: X-User-Name: admin Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: method: > Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: exception: Flavor 451 could not be found. Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: action_args: {'id': '451'} Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:49:34.426833 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:34.427683 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: ERROR nova.api.openstack.wsgi Oct 16 00:49:34.428810 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-a79403a7-6512-40de-9286-450fa9545347 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:49:34.429838 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-a79403a7-6512-40de-9286-450fa9545347 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011544 Oct 16 00:49:34.429838 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:49:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:35.646795 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:35.647828 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 16 00:49:35.648218 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:36.222196 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-d9eafb25-0bb7-4ddd-8900-44fb20c69c6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:36.247490 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-d9eafb25-0bb7-4ddd-8900-44fb20c69c6f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.460996 Oct 16 00:49:36.248034 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 16 00:49:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:37.466021 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:37.467024 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 16 00:49:37.467412 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:38.032805 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-5a8db5b8-c089-4f23-b480-7ce1afc85de5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:38.053758 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-5a8db5b8-c089-4f23-b480-7ce1afc85de5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.443997 Oct 16 00:49:38.054328 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 16 00:49:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:49:39.291541 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:39.292551 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 16 00:49:39.293143 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:39.853598 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-e8a60b11-a6da-4eff-9886-beae4b969914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:39.875641 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-e8a60b11-a6da-4eff-9886-beae4b969914 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.444771 Oct 16 00:49:39.876207 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 16 00:49:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:41.116098 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:41.117223 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Oct 16 00:49:41.117719 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:41.687545 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-3cc71277-2550-45e8-a211-e356b7088b01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:49:41.709574 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-3cc71277-2550-45e8-a211-e356b7088b01 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.446569 Oct 16 00:49:41.710116 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sun Oct 16 00:49:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:49:42.942009 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:42.943011 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 16 00:49:42.943397 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:49:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:49:43.494717 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-e5c18b07-1d55-4625-88aa-afeae82ecd21 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:43.515845 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-e5c18b07-1d55-4625-88aa-afeae82ecd21 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.437924 Oct 16 00:49:43.516689 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sun Oct 16 00:49:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:50:39.680284 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:39.681248 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-2bebafff-16d0-4d08-937e-8b5553193b3a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 16 00:50:39.681647 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 931 bytes} [Sun Oct 16 00:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:50:39.692438 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:40.104104 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-de020213-6afe-4d53-869b-e45f7c27a367 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:40.124421 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-de020213-6afe-4d53-869b-e45f7c27a367 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.436643 Oct 16 00:50:40.124966 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1292 bytes} [Sun Oct 16 00:50:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:50:40.146039 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_api:SELECT=14 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:40.149968 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-c86a817c-8e88-48ca-ab6b-d37104e8f880 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:40.157501 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-c86a817c-8e88-48ca-ab6b-d37104e8f880 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012954 Oct 16 00:50:40.158021 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 16 00:50:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:50:40.169734 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-393d6f43-0e6f-4126-908e-83a94f85637c admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:40.177120 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-393d6f43-0e6f-4126-908e-83a94f85637c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010928 Oct 16 00:50:40.177632 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 16 00:50:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:50:40.188969 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:40.196161 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010765 Oct 16 00:50:40.196665 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1286 bytes} [Sun Oct 16 00:50:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:50:40.208034 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-35e2a6b8-41cc-4501-bd5a-b1a39ec40d8d admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:50:40.215238 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-35e2a6b8-41cc-4501-bd5a-b1a39ec40d8d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010631 Oct 16 00:50:40.215771 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1283 bytes} [Sun Oct 16 00:50:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:53:54.234572 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:54.235577 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 16 00:53:54.235966 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:53:54.375665 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_api:SELECT=6 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:54.546423 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:54.551453 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:53:54.551927 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:53:54.552345 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:53:54.553079 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:53:54.553523 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:53:54.553933 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:53:54.585031 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-871b9dd0-c9c7-42b9-9761-d2192b7620f2 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.211465 Oct 16 00:53:54.585578 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:53:54 2022] GET /compute/v2.1/os-services => generated 785 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:53:55.665335 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:55.666337 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 16 00:53:55.666760 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:53:55.857843 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:55.861313 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:53:55.861776 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:53:55.862195 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:53:55.862928 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:53:55.863333 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:53:55.863743 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:53:55.882966 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-b69d5eda-4aaa-403e-b84f-ef04fe9eeeaf admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.078131 Oct 16 00:53:55.883454 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:53:55 2022] GET /compute/v2.1/os-services => generated 785 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:54:07.342641 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:54:07.343674 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 16 00:54:07.344062 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:54:07.488988 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_cell0:SELECT=4 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:07.489865 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_cell1:SELECT=4 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:07.490692 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG dbcounter [-] [103738] Writing DB stats nova_api:SELECT=8 {{(pid=103738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:07.543248 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:54:07.546655 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:54:07.547116 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:54:07.547531 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:54:07.548224 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:54:07.548656 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:54:07.549100 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:54:07.573604 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-fbd592cc-16f1-499f-b59a-b138e02aa323 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.092015 Oct 16 00:54:07.574147 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:54:07 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:54:08.646062 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG nova.api.openstack.wsgi [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] Calling method '>' {{(pid=103739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:54:08.647071 dv-cinder-master-3-smb devstack@n-api.service[103739]: INFO nova.api.openstack.requestlog [None req-b8d9cc1c-f885-4e0a-9f41-141748c10e32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 16 00:54:08.647470 dv-cinder-master-3-smb devstack@n-api.service[103739]: [pid: 103739|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sun Oct 16 00:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:54:08.848780 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG nova.api.openstack.wsgi [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Calling method '>' {{(pid=103738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:54:08.852167 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:54:08.852652 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:54:08.853466 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:54:08.854169 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:54:08.854612 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:54:08.855020 dv-cinder-master-3-smb devstack@n-api.service[103738]: DEBUG oslo_concurrency.lockutils [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:54:08.876302 dv-cinder-master-3-smb devstack@n-api.service[103738]: INFO nova.api.openstack.requestlog [None req-5abe65f7-97be-4d5d-b080-82451707ce12 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.089394 Oct 16 00:54:08.876851 dv-cinder-master-3-smb devstack@n-api.service[103738]: [pid: 103738|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sun Oct 16 00:54:08 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:55:18.710642 dv-cinder-master-3-smb devstack@n-api.service[103737]: Sun Oct 16 00:55:18 2022 - graceful shutdown triggered... Oct 16 00:55:18.711234 dv-cinder-master-3-smb devstack@n-api.service[103738]: Gracefully killing worker 1 (pid: 103738)... Oct 16 00:55:18.711684 dv-cinder-master-3-smb devstack@n-api.service[103739]: Gracefully killing worker 2 (pid: 103739)... Oct 16 00:55:18.712945 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 16 00:55:18.843009 dv-cinder-master-3-smb devstack@n-api.service[103739]: DEBUG dbcounter [-] [103739] Writing DB stats nova_api:SELECT=4 {{(pid=103739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:19.712468 dv-cinder-master-3-smb devstack@n-api.service[103737]: worker 1 buried after 1 seconds Oct 16 00:55:19.712468 dv-cinder-master-3-smb devstack@n-api.service[103737]: worker 2 buried after 1 seconds Oct 16 00:55:19.712468 dv-cinder-master-3-smb devstack@n-api.service[103737]: goodbye to uWSGI. Oct 16 00:55:19.715086 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 16 00:55:19.715978 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 16 00:55:19.720489 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 16 00:55:19.732993 dv-cinder-master-3-smb devstack@n-api.service[118965]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:55:19 2022] *** Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: nodename: dv-cinder-master-3-smb Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: machine: x86_64 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: clock source: unix Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: pcre jit disabled Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: detected number of CPU cores: 4 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: current working directory: / Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: your processes number limit is 47680 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: your memory page size is 4096 bytes Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: detected max file descriptor number: 2048 Oct 16 00:55:19.735173 dv-cinder-master-3-smb devstack@n-api.service[118965]: lock engine: pthread robust mutexes Oct 16 00:55:19.736387 dv-cinder-master-3-smb devstack@n-api.service[118965]: thunder lock: enabled Oct 16 00:55:19.736387 dv-cinder-master-3-smb devstack@n-api.service[118965]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 16 00:55:19.736387 dv-cinder-master-3-smb devstack@n-api.service[118965]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:55:19.775834 dv-cinder-master-3-smb devstack@n-api.service[118965]: Python main interpreter initialized at 0x563b01b7a9c0 Oct 16 00:55:19.775834 dv-cinder-master-3-smb devstack@n-api.service[118965]: python threads support enabled Oct 16 00:55:19.775834 dv-cinder-master-3-smb devstack@n-api.service[118965]: your server socket listen backlog is limited to 100 connections Oct 16 00:55:19.775834 dv-cinder-master-3-smb devstack@n-api.service[118965]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:55:19.776267 dv-cinder-master-3-smb devstack@n-api.service[118965]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:55:19.776267 dv-cinder-master-3-smb devstack@n-api.service[118965]: *** Operational MODE: preforking *** Oct 16 00:55:19.776555 dv-cinder-master-3-smb devstack@n-api.service[118965]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:55:19.776555 dv-cinder-master-3-smb devstack@n-api.service[118965]: spawned uWSGI master process (pid: 118965) Oct 16 00:55:19.784276 dv-cinder-master-3-smb devstack@n-api.service[118965]: spawned uWSGI worker 1 (pid: 118976, cores: 1) Oct 16 00:55:19.784276 dv-cinder-master-3-smb devstack@n-api.service[118965]: spawned uWSGI worker 2 (pid: 118977, cores: 1) Oct 16 00:55:19.784276 dv-cinder-master-3-smb devstack@n-api.service[118965]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:55:19.776771 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 16 00:55:20.439664 dv-cinder-master-3-smb devstack@n-api.service[118977]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:55:20.440265 dv-cinder-master-3-smb devstack@n-api.service[118976]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:55:21.576656 dv-cinder-master-3-smb devstack@n-api.service[118977]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:55:21.576656 dv-cinder-master-3-smb devstack@n-api.service[118977]: from cryptography.utils import int_from_bytes Oct 16 00:55:21.577403 dv-cinder-master-3-smb devstack@n-api.service[118977]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:55:21.577403 dv-cinder-master-3-smb devstack@n-api.service[118977]: from cryptography.utils import int_from_bytes Oct 16 00:55:21.578417 dv-cinder-master-3-smb devstack@n-api.service[118976]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:55:21.578417 dv-cinder-master-3-smb devstack@n-api.service[118976]: from cryptography.utils import int_from_bytes Oct 16 00:55:21.578900 dv-cinder-master-3-smb devstack@n-api.service[118976]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:55:21.578900 dv-cinder-master-3-smb devstack@n-api.service[118976]: from cryptography.utils import int_from_bytes Oct 16 00:55:23.965219 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:55:23.965920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:55:23.966013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:55:23.966357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:55:23.966442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:55:23.966520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:55:23.966609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:55:23.966687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:55:23.967041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.967153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:55:23.967233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:55:23.967305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.967558 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.967657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.967896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968055 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968231 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968499 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968609 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.968802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969165 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969473 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969734 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.969836 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970236 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970420 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.970884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.971141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.971322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.971522 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.971675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.971826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972006 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972166 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972627 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972794 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.972992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.973149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.973290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.973458 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.973837 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.974160 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.974471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.974791 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.975126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.975296 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.975450 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.975650 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.975806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.976046 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.976205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.976360 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.976686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.976882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.977045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.977383 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.977544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.978178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.978349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.978513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.978671 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.978814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.979153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.979440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.979667 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.979872 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980069 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980384 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980573 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.980934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981099 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981279 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.981940 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982444 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982768 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.982918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983203 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.983826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.984165 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.984385 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.984644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.984644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.985321 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.985487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.985633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.985791 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.985936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986834 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.986986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.987139 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.987282 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.987461 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.987461 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.987849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.988986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989726 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.989880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990022 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990323 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990486 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990630 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.990922 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991072 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.991880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992180 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992333 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.992976 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993716 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.993874 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.994017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.994318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.994479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.994640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.994884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.995260 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.995491 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.995641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.995792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.995937 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996241 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.996936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997539 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997700 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.997931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998097 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.998974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999277 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999726 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:23.999869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000025 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.000932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.001107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.001253 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.001504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.001649 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.001839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002004 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002612 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002755 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.002905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003371 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.003956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.004098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.004098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.004098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.004681 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.004875 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.005123 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.005513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.005758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.005907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006060 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006361 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006819 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.006963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.007875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.008139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.008290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.008442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.008594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.008915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009375 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009823 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.009983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010579 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.010885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011175 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011326 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011630 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011784 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.011969 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012405 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.012887 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013189 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013937 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.013937 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.014223 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.014539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.014700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.014852 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.015003 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.015284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.015664 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.015908 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.016058 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.016209 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.016365 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.016514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.016692 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.016997 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.017148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.017291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:55:24.017443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.017443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.017723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.017867 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.018017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.018177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.018421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.018662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.018816 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019375 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019684 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019835 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.019979 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020130 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020423 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020596 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.020977 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021458 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.021767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022265 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.022881 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023477 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.023911 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024348 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024808 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.024975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.025117 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.025477 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.025822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026051 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026208 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026362 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.026966 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027264 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027416 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027722 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.027874 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.028891 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029316 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029473 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.029921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030071 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030214 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030519 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.030963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031268 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031420 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031573 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031725 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031824 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.031912 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032047 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032152 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032571 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032769 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032877 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.032963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033697 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033790 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.033973 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034057 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034420 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034739 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034843 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.034943 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035037 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.035961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036690 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036783 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.036783 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037492 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037576 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.037918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.038023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.038226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.038522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.038621 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.038861 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.039085 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.039195 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.039475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.039646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.039793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.040115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.040217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.040429 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.040695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.040795 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041048 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041398 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.041965 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.042234 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.042422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.042525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.042820 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.043032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.043125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.043406 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.043626 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.043809 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044029 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044208 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044895 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.044992 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.045267 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.045376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.045697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.045965 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.046084 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.046228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.046455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.046548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.046869 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.047049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.047194 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.047504 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.047604 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.047817 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.048115 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.048211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.048449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.048678 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.048778 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.049081 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.049279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.049392 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.049699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.049854 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.050016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.050329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.050429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.050652 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.050911 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.051010 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.051269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.051478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.051570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.051873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.052035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.052212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.052543 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.052642 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.052908 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.053141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.053236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.053498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.053712 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.053823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.054202 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.054321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.054433 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.054743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.054970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.055071 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.055346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.055439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.055652 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.055886 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.056128 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.056261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.056502 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.056596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.056892 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.057153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.057266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.057502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.057713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.057813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.058124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.058308 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.058453 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.058760 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.058860 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.059101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.059370 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.059464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.059679 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.059951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.060054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.060286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.060519 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.060612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.060901 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.061126 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.061227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.061516 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.061699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.061826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.062135 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.062283 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.062440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.062753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.062844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.063061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.063363 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.063638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.063781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.064061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.064301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.064396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.064681 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065030 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065139 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065645 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.065957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.066208 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.066317 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.066544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.066637 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.066862 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.067117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.067376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.067467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.067723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.067815 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.068070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.068311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.068412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.068674 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.068920 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.069015 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.069375 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.069496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.069625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070131 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070244 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070622 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.070863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.071093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.071192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.071465 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.071675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.071769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.072074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.072240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.072376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.072689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.072789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.073018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.073313 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.073418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.073623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.073899 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.074000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.074231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.074474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.074567 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.074984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.075228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.075437 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.075536 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.075752 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.076031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.076138 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.076410 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.076620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.076728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.077083 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.077197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.077970 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078172 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.078580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.082869 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.082869 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090295 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090405 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.090935 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091226 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091311 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091404 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091703 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.091966 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092057 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092151 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092329 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.092412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093354 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093441 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.093958 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094135 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094228 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094321 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094500 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094674 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094759 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094855 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.094941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.095110 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.095110 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.095279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.095378 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.096334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.096615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.096705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.096994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.096994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.097768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098239 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098239 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098239 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.098553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099524 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.099956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100413 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100505 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100505 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100505 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.100864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.101241 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.101386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.101478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.101687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.101977 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.102070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.102295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103037 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103514 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.103824 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104010 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104172 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104518 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.104966 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.105921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106246 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106406 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.106897 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107210 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107352 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107665 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.107975 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.108141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.108284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.108467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.108617 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.108798 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109174 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109424 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109571 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.109844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110382 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.110896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111100 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111200 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.111808 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112022 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112115 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112330 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112638 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.112968 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113106 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113381 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.113904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114512 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.114816 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115051 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.115808 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116411 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116725 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.116952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.117914 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.118220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.118533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.118894 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.120876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.120983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121307 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121401 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121476 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121804 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.121955 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122041 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122345 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122416 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122642 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.122813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.123765 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.123765 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.123924 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124015 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124168 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124247 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124716 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124819 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.124932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125156 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125516 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125740 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.125839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126406 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126902 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.126999 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.127187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.127350 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.127525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.127603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.127899 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.128982 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129196 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129692 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.129847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130380 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.130989 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131099 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131299 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131404 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131605 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.131907 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132215 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132624 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132817 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.132957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133782 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.133898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134484 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.134839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135416 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135885 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.135977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136280 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136599 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136773 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.136902 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137489 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.137960 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138111 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138433 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.138913 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139224 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139525 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139673 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139828 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.139977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140134 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140619 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.140954 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141189 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141408 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141515 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141713 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.141810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142214 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142734 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.142829 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143136 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143432 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143776 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.143975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.144072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.144285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.144379 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.144616 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.144709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145001 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145116 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145867 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.145961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.146175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.146277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.146475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.146597 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.147784 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.147903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.147903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148081 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148177 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148359 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148460 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148558 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148859 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.148949 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149053 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149168 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149257 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149344 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.149905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150012 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150484 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150620 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.150921 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151253 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151347 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151554 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.151957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152281 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152598 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.152937 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.153166 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.153270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.153488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.153807 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.153908 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154123 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154228 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.154850 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155384 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.155849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.156912 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157225 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.157893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158215 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158397 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.158809 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.159965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160073 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160161 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.160966 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161066 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161387 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161710 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.161922 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162901 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.162994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163202 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163303 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163829 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.163927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164243 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164760 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.164878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165233 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.165809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166014 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166116 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166325 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166418 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166637 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.166962 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167065 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167394 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167614 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.167926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.168067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.168252 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.168376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.168548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.168680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169429 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169751 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.169974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170075 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170375 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170889 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.170984 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171196 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171602 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.171894 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172122 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172224 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.172827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173101 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173230 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173551 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.173840 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174062 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174681 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.174933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175366 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175659 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.175999 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176215 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176528 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.176959 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177177 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177569 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177783 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.177884 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178095 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178406 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.178799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179104 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179717 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.179924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180039 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180234 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.180942 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181144 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181237 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181557 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181754 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.181855 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182146 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182355 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182460 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182656 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.182963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.183970 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.184955 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185160 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185519 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185619 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.185916 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186143 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186238 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186446 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186553 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.186851 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187068 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187698 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.187804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188007 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188101 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188409 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188660 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.188786 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189023 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189558 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189664 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.189898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.190948 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191250 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.191861 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192389 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192482 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.192794 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193029 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193334 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.193956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.194976 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.195896 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196721 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.196901 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197184 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197816 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.197909 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198441 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198750 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.198843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199161 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199368 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199460 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199674 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199781 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.199986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200075 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200298 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.200943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.201916 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202010 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202333 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.202888 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203066 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203399 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203506 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.203822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204046 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204148 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204406 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204517 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.204822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205185 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205389 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.205796 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206004 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206401 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206613 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206708 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.206933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207239 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207540 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.207935 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.208145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.208245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.208447 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.208681 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.208770 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209068 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209175 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209370 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209676 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.209979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210583 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210693 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210881 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.210975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211482 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.211882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212503 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.212789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.213933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214035 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214242 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214567 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.214972 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.215889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216393 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.216799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217343 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217744 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.217958 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218891 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.218984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219217 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219310 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.219948 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220196 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220297 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220501 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220599 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220819 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.220985 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221310 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221462 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.221954 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222264 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222414 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222610 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.222928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223021 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223634 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223797 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.223944 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.224914 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225121 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225232 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225425 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225526 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.225830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226362 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226673 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226765 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.226981 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.227084 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.227290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.227391 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.227963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228273 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228375 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228583 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228676 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.228929 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.229021 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.229199 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:55:24.229300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.229540 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.229849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.230155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.230461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.230767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.231083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.231419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.231736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.232052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.232410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.232679 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.233014 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.233323 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.233630 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.233938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.234252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.234581 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.234893 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.235197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.235638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.235978 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.236297 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.236615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.236947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.237271 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.237593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.237902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.238222 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.238530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.238857 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.239197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.239533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.239855 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.240158 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.240460 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.240762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.241100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.241416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.241727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.242029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.242331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.242704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.243008 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.243315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.243670 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.243976 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.244283 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.244617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.244945 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.245248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.245549 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.245850 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.246149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.246458 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.246760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.247062 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.247364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.247666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.247967 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.248301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.248639 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.248978 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.249302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.249618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.249940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.250248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.250572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.250899 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.251235 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.251546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.251878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.252188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.252499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.252812 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.253147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.253459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.253769 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.254096 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.254430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.254724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.255050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.255367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.255686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.256002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.256311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.256639 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.256975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.257315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.257593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.257901 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.258212 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.258528 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.258837 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.259147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.259468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.259783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.260109 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.260435 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.260770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.261089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.261416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.261762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.262073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.262416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.262743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.263053 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.263362 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.263669 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:55:24.263910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:55:24.289414 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO dbcounter [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Registered counter for database nova_api Oct 16 00:55:24.310254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_db.sqlalchemy.engines [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.316907 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writer thread running {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.325535 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO dbcounter [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Registered counter for database nova_api Oct 16 00:55:24.346008 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.353485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writer thread running {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.372495 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.context [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=118976) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:55:24.376529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:55:24.377060 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:55:24.378639 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:55:24.379357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:55:24.379803 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:55:24.381894 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:55:24.383838 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO dbcounter [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Registered counter for database nova_cell0 Oct 16 00:55:24.387922 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO dbcounter [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Registered counter for database nova_cell1 Oct 16 00:55:24.395248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_db.sqlalchemy.engines [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.397668 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_db.sqlalchemy.engines [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.402771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writer thread running {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.405233 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writer thread running {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.409499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.context [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=118977) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:55:24.413546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:55:24.414018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:55:24.415593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:55:24.416312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:55:24.416764 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:55:24.418813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:55:24.420861 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO dbcounter [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Registered counter for database nova_cell0 Oct 16 00:55:24.425188 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO dbcounter [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Registered counter for database nova_cell1 Oct 16 00:55:24.432464 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.434742 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.439356 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writer thread running {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.549343 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO dbcounter [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Registered counter for database nova_cell0 Oct 16 00:55:24.556405 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_db.sqlalchemy.engines [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.561733 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writer thread running {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.577045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writer thread running {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.587352 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO dbcounter [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Registered counter for database nova_cell0 Oct 16 00:55:24.594078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:55:24.599229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writer thread running {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:55:24.873378 dv-cinder-master-3-smb devstack@n-api.service[118976]: WARNING keystonemiddleware.auth_token [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:55:24.880691 dv-cinder-master-3-smb devstack@n-api.service[118976]: WARNING keystonemiddleware.auth_token [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:55:24.917262 dv-cinder-master-3-smb devstack@n-api.service[118977]: WARNING keystonemiddleware.auth_token [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:55:24.924745 dv-cinder-master-3-smb devstack@n-api.service[118977]: WARNING keystonemiddleware.auth_token [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:55:25.225405 dv-cinder-master-3-smb devstack@n-api.service[118976]: WARNING keystonemiddleware.auth_token [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:55:25.231816 dv-cinder-master-3-smb devstack@n-api.service[118976]: WARNING keystonemiddleware.auth_token [None req-8cfc1be0-91d5-4210-b451-253e46130329 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:55:25.237639 dv-cinder-master-3-smb devstack@n-api.service[118976]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b01b7a9c0 pid: 118976 (default app) Oct 16 00:55:25.271464 dv-cinder-master-3-smb devstack@n-api.service[118977]: WARNING keystonemiddleware.auth_token [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:55:25.277587 dv-cinder-master-3-smb devstack@n-api.service[118977]: WARNING keystonemiddleware.auth_token [None req-4ec3e202-bb08-4ae1-8f2d-28dfcaa8e003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:55:25.283009 dv-cinder-master-3-smb devstack@n-api.service[118977]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b01b7a9c0 pid: 118977 (default app) Oct 16 00:56:04.754573 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f1173e27-d06d-49f8-be51-ba49b9f6a336 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807fbb0d0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:04.823285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:04.824443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:04.825412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:04.826207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:05.581126 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f1173e27-d06d-49f8-be51-ba49b9f6a336 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6935b133-f680-4b26-8d19-538b06c6901b" status: 200 len: 350 microversion: 2.1 time: 1.431228 Oct 16 00:56:05.581782 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 00:56:04 2022] GET /compute/v2.1/os-volumes/6935b133-f680-4b26-8d19-538b06c6901b => generated 350 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:07.775106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:07.776077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:07.778424 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:07.779681 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:08.284903 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1fd3636d-434f-4cb2-9cc2-17b564e30822 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807f79160>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:09.069658 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1fd3636d-434f-4cb2-9cc2-17b564e30822 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/42e99cbf-a0d9-4e11-94a7-d04b4ad76c4d" status: 200 len: 351 microversion: 2.1 time: 1.301509 Oct 16 00:56:09.096975 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 00:56:07 2022] GET /compute/v2.1/os-volumes/42e99cbf-a0d9-4e11-94a7-d04b4ad76c4d => generated 351 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:10.793339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-71a8b8b9-dc43-45d6-9e54-012ca5f9621b tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807def3a0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:10.906293 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-71a8b8b9-dc43-45d6-9e54-012ca5f9621b tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/62424b2e-aa2e-4224-bb47-25986208b0ae" status: 200 len: 350 microversion: 2.1 time: 0.116965 Oct 16 00:56:10.907225 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 00:56:10 2022] GET /compute/v2.1/os-volumes/62424b2e-aa2e-4224-bb47-25986208b0ae => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:10.921528 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-730f6556-fd3e-4e71-8dce-66c511a460a3 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807e3f310>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.117880 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-730f6556-fd3e-4e71-8dce-66c511a460a3 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.200707 Oct 16 00:56:11.118670 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 16 00:56:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:11.135494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ad507964-d0a9-48ce-bdcc-d72d89c54ec7 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807def550>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.328441 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ad507964-d0a9-48ce-bdcc-d72d89c54ec7 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.196772 Oct 16 00:56:11.329618 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 16 00:56:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:11.345541 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-27b3b983-87a6-4b50-831b-84e4601ac189 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807dfa0d0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.499655 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-27b3b983-87a6-4b50-831b-84e4601ac189 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.159252 Oct 16 00:56:11.511838 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 16 00:56:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:11.515256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cc127b67-0b64-486c-bcf0-d4979356810f tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807defdc0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.720819 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cc127b67-0b64-486c-bcf0-d4979356810f tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.209540 Oct 16 00:56:11.721875 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 16 00:56:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:11.737863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-de1fb691-c1dd-4c46-86b2-e610db35436c tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807e105e0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.971861 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-de1fb691-c1dd-4c46-86b2-e610db35436c tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.239153 Oct 16 00:56:11.986132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ef98dbf3-60c7-4843-bd89-027b1f2ee0f6 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807e14700>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:11.989126 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1170 bytes} [Sun Oct 16 00:56:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:12.141773 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ef98dbf3-60c7-4843-bd89-027b1f2ee0f6 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.159256 Oct 16 00:56:12.152245 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 16 00:56:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:12.159754 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0bd93d39-eb1e-44f3-a45c-459db1fcd100 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807e10790>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:12.415760 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0bd93d39-eb1e-44f3-a45c-459db1fcd100 tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.262558 Oct 16 00:56:12.426181 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 16 00:56:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:12.431563 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2c8e841d-3569-452d-85ad-e2602a0ddfac tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] Calling method '.version_select at 0x7f5807e148b0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:12.607779 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2c8e841d-3569-452d-85ad-e2602a0ddfac tempest-VolumesTestJSON-1640600762 tempest-VolumesTestJSON-1640600762-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.180415 Oct 16 00:56:12.608962 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 16 00:56:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:14.389876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1153193918", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "b2535b2d-b7fe-4238-83a8-d9ed64ed2d8f"}]}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:14.619750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] validate_networks() for [('b2535b2d-b7fe-4238-83a8-d9ed64ed2d8f', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:16.824341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:16.825018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:16.825349 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:16.825929 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:16.826565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:16.893368 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:16.899546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:16.899546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:16.899546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:16.899546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:16.901548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:17.020954 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Getting quotas for project f9ecfb8b74ec4e03bc149b1e1b56c356. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:17.060395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Getting quotas for user 3aca3737ea4c40a89384bdf5e77d90f5 and project f9ecfb8b74ec4e03bc149b1e1b56c356. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:17.107118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:17.121806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:17.314020 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-896a8b92-398f-48f1-976c-a5d2c62d8a23 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.241360 Oct 16 00:56:17.329359 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 6/12] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 00:56:17.344785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4f982daa-f860-44b5-83a1-4aa15df9c84f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:17.349758 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4f982daa-f860-44b5-83a1-4aa15df9c84f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:17.686698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4f982daa-f860-44b5-83a1-4aa15df9c84f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:17.719987 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4f982daa-f860-44b5-83a1-4aa15df9c84f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1215 microversion: 2.1 time: 0.390038 Oct 16 00:56:17.723175 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:17 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:17.937005 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-156cd4ba-ba6e-4879-84ad-8597d0f8460a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: .version_select at 0x7f5807defee0>, body: {"keypair": {"name": "tempest-keypair-329458898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx4m/gnWhiGGIAajqhaAFyYErzOcDAPUW0e9wGyAcZ1I96fkHbTYrVSNZIlpPOKP/KwF4wJGB9QccqXmi/hmfJXf7osIUSX4+u7IzHRlEl6Pfe8PkAwd+TCtPaEDr2qOw=="}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:18.094296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-156cd4ba-ba6e-4879-84ad-8597d0f8460a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:18.116810 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-156cd4ba-ba6e-4879-84ad-8597d0f8460a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for user 6538a3de44cd4650b31aab5f169a8abe and project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:18.237699 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-156cd4ba-ba6e-4879-84ad-8597d0f8460a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.256755 Oct 16 00:56:18.276526 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 7/14] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 16 00:56:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1297 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 16 00:56:18.752414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7385c5d4-3f62-4bec-9fd8-64d7cee74520 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:18.754071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7385c5d4-3f62-4bec-9fd8-64d7cee74520 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:18.962670 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7385c5d4-3f62-4bec-9fd8-64d7cee74520 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:18.981054 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7385c5d4-3f62-4bec-9fd8-64d7cee74520 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1215 microversion: 2.1 time: 0.233137 Oct 16 00:56:18.983770 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:18 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:20.015380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1048138403", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:20.017432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-29e31773-7624-4fed-ac1e-75f4ea0f2703 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:20.018065 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-29e31773-7624-4fed-ac1e-75f4ea0f2703 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:20.307485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-29e31773-7624-4fed-ac1e-75f4ea0f2703 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:20.332477 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-29e31773-7624-4fed-ac1e-75f4ea0f2703 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1215 microversion: 2.1 time: 0.323726 Oct 16 00:56:20.334878 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:20 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:20.338489 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] validate_networks() for [('b52ba8d5-af32-4783-a739-c1ea3883d1e9', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:20.845464 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5f761666-7e9f-4e90-b06c-896345bb809c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: .version_select at 0x7f5807dfab80>, body: {"keypair": {"name": "tempest-keypair-823826492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXuP6NjDG8EhJn0M8LHIaQF5FclMbHU+gmkeC4tL+zfN7fFBR+6YVs5KsrRTgfYO5nwXMmzVYSQAnyKZNB/bmoSDzl5ZxgPHhRuggrLt2rasf/9e2iBAOfXqnXkpTKgnQ=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:20.908427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-5f761666-7e9f-4e90-b06c-896345bb809c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for project 467164d5c9154ed5ad79e0257e95de97. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:20.916112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-5f761666-7e9f-4e90-b06c-896345bb809c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for user 63527c420b154db4abb6e832e46ccd05 and project 467164d5c9154ed5ad79e0257e95de97. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:21.004086 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5f761666-7e9f-4e90-b06c-896345bb809c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.495461 Oct 16 00:56:21.005501 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 10/17] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 00:56:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:21.375962 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:21.377341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:21.395089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:21.404232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:21.407315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:21.410194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:21.412512 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:21.414911 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:21.841906 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:21.881124 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-252a922b-4407-457a-93dd-166475259469 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1267 microversion: 2.1 time: 0.512804 Oct 16 00:56:21.882250 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 11/18] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:21 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1267 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:22.913947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:22.915586 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:22.928648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:22.932571 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:22.933537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:22.936664 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:22.937771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:22.940482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:23.386959 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:23.420169 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0cb374fe-f8dd-46ec-8770-d308f5a8dc1f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1273 microversion: 2.1 time: 0.510125 Oct 16 00:56:23.431240 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 12/19] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:22 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:23.622295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:23.622856 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:23.623552 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:23.624173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:23.624736 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:23.653414 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:23.654269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:23.655023 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:23.656812 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:23.659629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:23.660180 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:23.723507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:23.742991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for user bb8be65b81ca4eee9a524ddb6577d188 and project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:23.764275 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:23.768749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:23.964032 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-21eefca3-6abb-43f2-9813-7b2d59b57661 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.371335 Oct 16 00:56:23.969291 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 8/20] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:56:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 4379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:56:23.977652 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ca26a796-2b66-4d3f-bd1a-242459be3ad3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:23.978908 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ca26a796-2b66-4d3f-bd1a-242459be3ad3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:24.290130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ca26a796-2b66-4d3f-bd1a-242459be3ad3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:24.303293 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ca26a796-2b66-4d3f-bd1a-242459be3ad3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1222 microversion: 2.1 time: 0.328029 Oct 16 00:56:24.307436 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 13/21] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:23 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:24.449458 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:24.450273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:24.489028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:24.489805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:24.490394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:24.491264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:24.494502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:24.494937 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:24.871264 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-966903510", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:25.073082 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] validate_networks() for [('b52ba8d5-af32-4783-a739-c1ea3883d1e9', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:26.963740 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:28.167192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:28.220004 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-58f4ec6a-c2c2-47da-b854-07710e18ff96 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 3.776132 Oct 16 00:56:28.233874 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 9/22] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:24 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 3790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:28.241226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-429943962", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2751c9ed-756d-4ad3-a0df-a613fb9d3d22"}], "security_groups": [{"name": "tempest-securitygroup--1802665852"}], "key_name": "tempest-keypair-329458898", "user_data": "}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:29.131054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] validate_networks() for [('2751c9ed-756d-4ad3-a0df-a613fb9d3d22', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:30.500035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:30.500804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:30.501132 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:30.501923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:30.502476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:30.532549 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:30.533500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:30.534054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:30.536647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:30.537328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:30.537894 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:30.599821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:30.612088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for user bb8be65b81ca4eee9a524ddb6577d188 and project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:30.674080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:30.692555 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:30.833831 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f6a4a993-f115-4bc4-b541-1da3aedd5cfe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.962509 Oct 16 00:56:30.843481 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 14/23] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:56:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 5978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 00:56:30.868655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:30.868655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:30.881056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:30.881562 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:30.882305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:30.883305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:30.888445 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:30.889073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.006727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:31.007744 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:31.008690 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:31.009170 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:31.009388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:31.049694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:31.055979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:31.058601 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.067295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:31.070351 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:31.073262 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.188124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:31.222678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for user 6538a3de44cd4650b31aab5f169a8abe and project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:31.291682 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:31.302428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:31.544692 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b8e3d548-f87b-402b-886d-ba0a8af0c7b7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.307068 Oct 16 00:56:31.546911 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 10/24] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 16 00:56:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 00:56:31.820826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46db3fd-ce68-4a8b-a238-89d710f6eef5", "tag": "2303cb8c-5ee9-469c-a4fc-cce088e0cbc4"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:31.862244 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:31.862769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:31.872182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.935068 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Creating event network-changed:2303cb8c-5ee9-469c-a4fc-cce088e0cbc4 for instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 on hv-cinder-maste Oct 16 00:56:31.935618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 00:56:31.936030 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c026f4ea-0734-457d-aa45-ee691b97e822 req-6e0a1b52-0a25-41a7-9b74-2163a0f81a41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 00:56:31.951494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:31.952057 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:31.952581 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.953572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:31.953885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:31.960466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:31.987540 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.compute.rpcapi [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 16 00:56:32.010129 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] Releasing lock "compute-rpcapi-router" {{(pid=118976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 00:56:32.108933 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3a725060-641a-45a2-a2fa-d1a1fe61e504 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.554434 Oct 16 00:56:32.111468 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 11/25] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:32.124057 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9826c0fc-6632-4a81-bbe0-8c9ffd0ffa94 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:32.124829 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9826c0fc-6632-4a81-bbe0-8c9ffd0ffa94 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:32.713474 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9826c0fc-6632-4a81-bbe0-8c9ffd0ffa94 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:32.764796 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9826c0fc-6632-4a81-bbe0-8c9ffd0ffa94 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1221 microversion: 2.1 time: 0.651967 Oct 16 00:56:32.771610 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 12/26] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:32 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1221 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:32.811212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:32.814555 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:33.008897 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:33.031577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:33.044183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:33.052860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:33.055655 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-43f6db8e-4a70-4f45-bb96-dbd0efaba0f9 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 2.210204 Oct 16 00:56:33.060178 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7efd23b8-8f60-4532-82fa-c0a39fe1c7a6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1280 microversion: 2.20 time: 0.287162 Oct 16 00:56:33.060790 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 13/27] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:32 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:33.062385 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:30 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:33.109571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1327560824", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385d8cb9-6173-49a8-a000-9036557916d2"}], "security_groups": [{"name": "tempest-securitygroup--1320538733"}], "key_name": "tempest-keypair-823826492", "user_data": "}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:33.551594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] validate_networks() for [('385d8cb9-6173-49a8-a000-9036557916d2', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:33.802080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:33.805653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:33.836328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:33.842252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:33.842747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:33.850489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:33.851023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:33.851467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:34.383780 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:34.395269 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2c084192-f536-4ea4-8b39-b281335adaa5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1273 microversion: 2.1 time: 0.605036 Oct 16 00:56:34.401399 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:33 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1273 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:34.421421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:34.423529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:34.461798 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:34.462376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:34.471847 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:34.480300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:34.481306 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:34.492967 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:35.248176 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:35.315745 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-cc724414-b2e6-4f2c-a4eb-2741943b7a3a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.916233 Oct 16 00:56:35.316659 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 17/30] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:34 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:35.338361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:35.347233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:35.382807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:35.383608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:35.384091 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:35.385112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:35.385582 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:35.388358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:35.718531 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:35.744460 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:35.755056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:35.757704 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6c366fad-435d-4513-9218-818d819cceb4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1332 microversion: 2.20 time: 0.435873 Oct 16 00:56:35.778124 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 18/31] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:35 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1332 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:35.804727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:35.806960 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:35.838468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:35.839942 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:35.841399 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:35.850648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:35.852752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:35.857177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:36.520812 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:36.530914 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a4a118ca-c2fc-41ab-bdd7-eab6a0a8cae6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1279 microversion: 2.1 time: 0.741983 Oct 16 00:56:36.537141 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 19/32] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:35 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1279 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:36.556329 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:36.559256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:36.574956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:36.586735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:36.589662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:36.594614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:36.596884 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:36.597555 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.279578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:37.301167 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d49dba64-53e6-4352-b871-a18a16ded3da tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.760810 Oct 16 00:56:37.301960 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 20/33] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:36 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:37.327675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:37.331470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:37.343208 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.344072 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.345015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.346671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.348075 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.348934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.416616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:37.419338 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:37.420254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:37.420893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:37.427054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:37.471105 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.474256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.479272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.479272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.481185 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.482085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.559302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for project 467164d5c9154ed5ad79e0257e95de97. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:37.576283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for user 63527c420b154db4abb6e832e46ccd05 and project 467164d5c9154ed5ad79e0257e95de97. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:37.619750 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:37.627838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:37.752111 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-24be1e3a-b534-4855-9080-155ae813dd67 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.688451 Oct 16 00:56:37.753663 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 14/34] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:56:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 4692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:56:37.759725 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34fac95-f3ff-47f0-b784-01e96481a86b", "tag": "bbd562e2-b40f-4d38-9d0e-61a02f4c454b"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:37.787940 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.789081 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.793349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.833252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:37.843306 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:37.844744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:37.858927 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9bca0b44-39ad-4e15-86b0-994590555214 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1338 microversion: 2.20 time: 0.554047 Oct 16 00:56:37.861313 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] Creating event network-changed:bbd562e2-b40f-4d38-9d0e-61a02f4c454b for instance f34fac95-f3ff-47f0-b784-01e96481a86b on hv-cinder-maste Oct 16 00:56:37.865246 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 21/35] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:37 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1338 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:37.889391 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:37.890188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:37.912675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.915582 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.917395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.918335 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:37.923810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:37.941402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:37.942203 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-e6b5ca78-2a42-499b-b960-a23639384a32 req-bed766bf-39df-43ca-8047-af421e0b9741 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182291 Oct 16 00:56:37.943893 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 15/36] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:37.972979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-199b9860-8fbd-46dc-95d5-3eb4e00d4904 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:37.978087 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-199b9860-8fbd-46dc-95d5-3eb4e00d4904 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:38.460069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-199b9860-8fbd-46dc-95d5-3eb4e00d4904 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:38.492005 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-199b9860-8fbd-46dc-95d5-3eb4e00d4904 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1237 microversion: 2.1 time: 0.537306 Oct 16 00:56:38.515727 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 16/37] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:37 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1237 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:38.530118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:38.533990 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:38.549735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:38.553074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=63 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:38.561999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:38.563546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:38.566273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:38.567418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:38.569484 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:38.570081 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:38.571442 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fb9f3eea-8274-4613-8541-c688d935bda5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1279 microversion: 2.1 time: 0.703805 Oct 16 00:56:38.585477 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 22/38] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:37 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1279 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:38.894282 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:38.895797 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:38.905186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:38.909904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:38.912313 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:38.915785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:38.917044 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:38.917775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:38.920164 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:39.318833 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:39.346432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:39.362402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:39.366272 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-df45481a-390c-4167-ab16-00d5866d6c90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1338 microversion: 2.20 time: 0.476920 Oct 16 00:56:39.383173 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 23/39] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:38 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1338 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:39.519787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:39.524220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:39.534280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:39.537743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:39.538421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:39.540923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:39.541962 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:39.542584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:40.065851 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.082343 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a4d1933a-1e78-4dce-8655-5149f146fcad tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 1.564610 Oct 16 00:56:40.098102 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 17/40] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:38 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:40.114527 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:40.115196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:40.131337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:40.131893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:40.132464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:40.133214 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:40.133670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:40.134122 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:40.168048 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.181288 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-897388f1-a76e-404f-b0ce-f5c11cf9d5a2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1233 microversion: 2.1 time: 0.666251 Oct 16 00:56:40.202949 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 24/41] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:39 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1233 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:40.395546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:40.396261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:40.409358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:40.410077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:40.413640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:40.414615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:40.415286 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:40.415921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:40.419711 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.435268 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0dfd4cc0-77aa-4d82-afc9-b5b758a50f6a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.335304 Oct 16 00:56:40.458361 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 18/42] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:40 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:40.557823 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.567751 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.574604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:40.575867 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-93fbcf1d-0762-4353-8c72-9763df1e686d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1338 microversion: 2.20 time: 0.185151 Oct 16 00:56:40.582693 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 25/43] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:40 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:41.114072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:41.114688 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:41.123972 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.125113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.125967 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.126686 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.127145 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.127909 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.208573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:41.210015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:41.221403 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:41.222911 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=24 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:41.225828 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.226479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.227638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.229365 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.230010 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.230723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.333365 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.341538 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ea3d94a5-9567-44c6-8393-8c3bb366e771 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1289 microversion: 2.1 time: 0.137459 Oct 16 00:56:41.342119 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 26/44] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:41 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:41.436854 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.447688 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4f0304a1-227d-47dc-ae56-0de22fcd1169 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.337818 Oct 16 00:56:41.448355 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 19/45] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:41 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:41.465634 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:41.466913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:41.474784 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.475660 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.476279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.477471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.478178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.478902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.607875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:41.608546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:41.618028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.619802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.621163 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.622426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:41.623627 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:41.626193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:41.812720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.824445 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-43831537-f9a7-4d82-ab0b-5c4a0e8e6bef tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.362624 Oct 16 00:56:41.828321 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 27/46] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:41 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:41.897039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.912632 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.917828 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:41.921963 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d31ab5e7-1cd5-4244-9eb1-92ac179cb477 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.317167 Oct 16 00:56:41.922594 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 20/47] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:41 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:42.367603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:42.371278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:42.383771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.386322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.389557 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.391754 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.392331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.392747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.471479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:42.472296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:42.479615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.480104 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.480537 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.481635 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.484647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.486329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.492733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:42.504045 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1e0a4208-17c5-4dda-810c-4a00a26f79fd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1289 microversion: 2.1 time: 0.141235 Oct 16 00:56:42.505604 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 28/48] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:42 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1289 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:42.665589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:42.675107 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-10201bf5-8a9a-4cde-b9f6-602d5d50e3bf tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.207379 Oct 16 00:56:42.675685 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 21/49] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:42 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:42.867932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:42.869927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:42.878778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.879269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.879788 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.881101 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.881633 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.882910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.952268 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:42.953202 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:42.971003 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.971508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.971943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:42.972647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:42.973119 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:42.973600 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.167953 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.186001 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bd5a899d-1135-426f-8817-f9bd7ea9d54a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.338014 Oct 16 00:56:43.191197 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 29/50] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:42 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:43.261701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.277864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.279300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.280482 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7ba6634f-d322-4dcc-af6d-db35cdd9c2e2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.332889 Oct 16 00:56:43.289688 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 22/51] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:42 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:43.498171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:43.519748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.523112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.524073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.534615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:43.536773 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:43.558954 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.559882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.560539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.561739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.562663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.563292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.600979 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Creating event network-changed:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:56:43.601532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118977) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 00:56:43.603767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0da06cfc-4279-42d2-8187-5c7c363055e3 req-e3efa42b-d593-428a-a320-57a0923bd68d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118977) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 00:56:43.605397 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.610841 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.611346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.612059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.612518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.612971 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.631877 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.compute.rpcapi [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 16 00:56:43.633069 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] Releasing lock "compute-rpcapi-router" {{(pid=118977) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 00:56:43.657720 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e3c028eb-44ea-4721-bc0f-21d5aa7b71da None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165005 Oct 16 00:56:43.658729 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 30/52] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:43.660826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.670998 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b4d95617-8596-4753-88d9-d0a853593f53 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1289 microversion: 2.1 time: 0.141153 Oct 16 00:56:43.684045 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 23/53] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:43 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1289 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:43.699844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:43.700702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:43.708442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.708907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.709347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.710045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:43.710499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:43.710918 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:43.873989 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:43.886388 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-88429c11-9a26-478d-96d5-8aa4656267bd tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.190128 Oct 16 00:56:43.887176 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 31/54] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:43 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:44.212727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:44.214374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:44.233346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.234082 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.234995 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.235938 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.236404 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.237570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.320020 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:44.320730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:44.329367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.329941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.330377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.331076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.331524 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.331997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.493317 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:44.503519 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d1aa1d89-8253-487a-a3e8-998184dffcac tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.294858 Oct 16 00:56:44.504112 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 24/55] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:44 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:44.563785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:44.579202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:44.581347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:44.584531 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0e623e9f-53e9-44e5-b5a3-3f1c0a67c3c8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.269354 Oct 16 00:56:44.586118 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 32/56] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:44 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:44.697998 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:44.699709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:44.717009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:44.722135 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.722634 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.723102 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.723842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.724336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.732418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.849147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:44.876684 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e219dddc-f04d-43ee-bb04-abd5cbfc1580 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1289 microversion: 2.1 time: 0.184768 Oct 16 00:56:44.884321 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 25/57] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:44 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1289 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:44.912770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:44.913381 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:44.939169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.939724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.942591 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:44.945650 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:44.948784 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:44.951461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.221369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:45.241108 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bb038648-1ca9-4093-b80e-ce45065f8ed2 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.333863 Oct 16 00:56:45.258028 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 33/58] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:44 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:45.536507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:45.537472 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:45.547443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.548168 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.548753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.556462 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.557330 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.558144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.612678 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:45.613320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:45.628824 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.628824 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.629218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.629936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.630379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.630800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.890887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:45.898673 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-85af658d-b296-4c13-95cf-aacecb261e72 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.367158 Oct 16 00:56:45.901663 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 26/59] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:45 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:45.915889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b5d739-45c6-406a-a9e6-3f9907102a15", "tag": "35acdc7e-ec4e-4155-8024-e8e4f947291d"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:45.935786 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:45.941545 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.947309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:45.948745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:45.949719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.950147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.954097 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c6fe0de3-5220-4833-89db-d0a848bec04c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.345627 Oct 16 00:56:45.954671 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 34/60] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:45 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:45.966791 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:45.967643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:45.971649 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] Creating event network-changed:35acdc7e-ec4e-4155-8024-e8e4f947291d for instance 70b5d739-45c6-406a-a9e6-3f9907102a15 on hv-cinder-maste Oct 16 00:56:45.978313 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.980876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.982761 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:45.983693 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:45.984153 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-9bd50fa5-20e0-44cf-aa44-dd008e031900 req-faa3a2ca-0f23-48e5-9ded-6935d5d90849 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078181 Oct 16 00:56:45.984763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:45.985552 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 27/61] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:45.987475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.060305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:46.068379 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-dcaea43a-2190-49ad-9b96-27f7b32e8105 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1297 microversion: 2.1 time: 0.112056 Oct 16 00:56:46.083822 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 35/62] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:45 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:46.266298 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:46.266988 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:46.277076 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.278158 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.278605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.279309 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.280250 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.280389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.709586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:46.717653 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-71c138b6-bcff-48b0-b94a-1291ccd40384 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.455537 Oct 16 00:56:46.723934 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 28/63] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:46 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:46.923130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:46.923730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:46.930478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.931167 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.931601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.932443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.932745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.933214 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.982512 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:46.983234 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:46.992999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.993515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.994223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:46.995261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:46.995769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:46.996738 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:47.003103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=87 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:47.301789 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:47.323364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:47.324930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:47.334513 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:47.338008 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-56ac4ee0-1eb3-4d3e-a2f8-339e563dfc34 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.360519 Oct 16 00:56:47.339465 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 29/64] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:46 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:47.358285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:47.359648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:47.361795 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-35c6c62b-2a54-4e50-b3e8-57406b2ad996 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.442630 Oct 16 00:56:47.367528 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 36/65] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:46 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:47.389569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:47.396999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:47.397871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:47.403814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:47.404329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:47.404800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:47.512494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=8 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:47.519425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:47.545156 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ee57a8e1-9e6a-4d6d-a95d-257676a4eec4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1295 microversion: 2.1 time: 0.200180 Oct 16 00:56:47.546142 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 30/66] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:47 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:47.751917 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:47.752650 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:47.768249 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:47.768743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:47.769232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:47.769938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:47.770387 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:47.770916 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.243047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:48.256639 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f5c8820b-e368-4647-9008-2f025eec484d tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.509006 Oct 16 00:56:48.261176 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 37/67] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:47 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:48.365488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:48.366124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:48.373057 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.373901 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.374569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.375498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.376021 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.376503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.390535 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:48.391369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:48.401129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.403119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.403686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.408497 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.409207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.410328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.484102 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=28 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:48.804449 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:48.814055 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-965884a2-e623-49ee-bc2d-7f85de81e6d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.428264 Oct 16 00:56:48.814663 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 38/68] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:48 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:48.828644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:48.829334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:48.836302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.837653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.838274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:48.839336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:48.840295 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:48.840937 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:49.060227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:49.074360 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:49.077517 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:49.082414 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-27355b97-06c6-4e72-870a-4be3dcd950cf tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.719018 Oct 16 00:56:49.083015 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 31/69] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:48 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:49.150398 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:49.161366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=100 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:49.169442 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-66d311f7-6c95-4df5-8fe8-6d59b250de0c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1295 microversion: 2.1 time: 0.347377 Oct 16 00:56:49.183279 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 39/70] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:48 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1295 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:49.291055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:49.292034 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:49.301932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:49.303201 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:49.304306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:49.305398 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:49.312533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:49.313629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:49.752100 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:49.762949 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4e518d18-d43f-4bc3-ae97-dc685b20fdc7 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.480103 Oct 16 00:56:49.769601 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 32/71] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:49 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:49.845000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:49.846256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:49.861388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:49.863965 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:49.864575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:49.865956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:49.869497 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:49.870297 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.045378 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46db3fd-ce68-4a8b-a238-89d710f6eef5", "name": "network-vif-plugged", "status": "completed", "tag": "2303cb8c-5ee9-469c-a4fc-cce088e0cbc4"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:50.057300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:50.067593 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-00ba2186-433b-4d8c-8ce2-30931eabc7ae tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.227831 Oct 16 00:56:50.087123 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 33/72] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:49 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:50.088038 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.088740 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.089386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.110780 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:50.111759 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:50.118119 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] Creating event network-vif-plugged:2303cb8c-5ee9-469c-a4fc-cce088e0cbc4 for instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 on hv-cinder-maste Oct 16 00:56:50.124158 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-c0905220-b50d-4b0b-aaa9-61dc2378f440 req-cd1574fb-654c-4ae7-bc1c-e02d9dd75124 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.544989 Oct 16 00:56:50.125285 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 40/73] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:56:50.125653 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.126144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.126806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.129994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.130499 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.131395 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.198293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:50.199320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:50.212460 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.219002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.219002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.219002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.219643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.220410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.420320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:50.428631 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:50.430110 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:50.431226 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7b321b6f-6d16-49ae-b083-afa1e781ec5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.325248 Oct 16 00:56:50.449413 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 34/74] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:50 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:50.482400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:50.492561 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c1aa669e-2942-40ef-ae23-31090dad541b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.299626 Oct 16 00:56:50.494274 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 41/75] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:50 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:50.793867 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:50.794747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:50.801491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.802298 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.803237 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.804177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:50.805022 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:50.805621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:50.929304 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1977480048", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "65a8cf83-a005-429e-aac3-a9a1859deeaa"}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:51.023095 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] validate_networks() for [('65a8cf83-a005-429e-aac3-a9a1859deeaa', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:56:51.137416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:51.147938 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-548d76af-9a01-428c-8d04-53f8d94cb130 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.358878 Oct 16 00:56:51.150566 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 42/76] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:50 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:51.157980 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:51.159309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:51.176352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:51.177185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:51.177828 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:51.180955 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:51.181661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:51.182285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:51.707683 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:51.729851 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4d266911-1b81-4169-b5d4-275943c12af3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.578002 Oct 16 00:56:51.730909 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 43/77] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:51 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:51.745440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:51.746117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:51.760519 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:51.761027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:51.761455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:51.762154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:51.762763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:51.763330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.217632 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.226347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.228426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.229847 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4ea34aad-409c-413f-a1c5-5256f745dbbd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.497827 Oct 16 00:56:52.230314 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 44/78] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:51 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:52.234902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:52.235634 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:52.242734 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.243538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.244436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.245487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.246299 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.246933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.252614 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:56:52.253137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:56:52.253762 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:56:52.254256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:56:52.254730 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:56:52.270636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.271118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.274538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.275287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.276220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.281150 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.307110 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Getting quotas for project 925b11e4612b49f88fa6812d55e15c0c. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:56:52.311178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Getting quotas for user b44fd5c928ea4a4289f24e6b825b98fa and project 925b11e4612b49f88fa6812d55e15c0c. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:56:52.322951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:56:52.325292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:56:52.399119 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2fe73fc6-1f92-4fac-a504-a27b8b6ec28d tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.818244 Oct 16 00:56:52.399917 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 35/79] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:56:52.405553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34fac95-f3ff-47f0-b784-01e96481a86b", "name": "network-vif-plugged", "status": "completed", "tag": "bbd562e2-b40f-4d38-9d0e-61a02f4c454b"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:52.421151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.421965 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.422566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.441489 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] Creating event network-vif-plugged:bbd562e2-b40f-4d38-9d0e-61a02f4c454b for instance f34fac95-f3ff-47f0-b784-01e96481a86b on hv-cinder-maste Oct 16 00:56:52.448695 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-d3528ab5-ed81-41c7-b44b-25a667cab278 req-e7af43ef-c642-4e43-b313-40840138da97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046658 Oct 16 00:56:52.449741 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 36/80] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:52.466230 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:52.467327 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:52.475554 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.476318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.477329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.478475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.479124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.479704 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.545814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.558847 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f65428d8-fce9-478a-872e-ce6c6f40c30a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.327320 Oct 16 00:56:52.559718 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 45/81] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:52 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:52.573054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-43c40c4e-8698-4a5b-9bc1-736bfc8b4fc4 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:52.575276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-43c40c4e-8698-4a5b-9bc1-736bfc8b4fc4 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:52.701501 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-43c40c4e-8698-4a5b-9bc1-736bfc8b4fc4 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.713196 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-43c40c4e-8698-4a5b-9bc1-736bfc8b4fc4 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1214 microversion: 2.1 time: 0.151531 Oct 16 00:56:52.714662 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 46/82] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:52 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:52.755722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:52.756622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:52.769147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.771035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.771846 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.774142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:52.776179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:52.777256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:52.801886 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:52.814594 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9ea7a663-e297-48ae-b3d7-9e054096a273 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.361068 Oct 16 00:56:52.816972 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 37/83] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:52 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:53.138526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.146977 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-35d17a50-6b4b-437a-8381-3c58a182bff4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.396341 Oct 16 00:56:53.151843 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 47/84] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:52 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:53.254843 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:53.256621 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:53.264284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.265347 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.266006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.266782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.268173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.269001 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.369927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630316f0-8515-4ba3-b433-29c96907a8b2", "tag": "a781e62b-4499-48b4-bb7f-86dce780562d"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:53.382160 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.382743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.383378 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.395785 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] Creating event network-changed:a781e62b-4499-48b4-bb7f-86dce780562d for instance 630316f0-8515-4ba3-b433-29c96907a8b2 on hv-cinder-maste Oct 16 00:56:53.401846 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-df02b14b-b3d9-4d7d-9e16-2fa12cdfd867 req-d6399c2e-ac2d-428a-b512-9eb0e6a1a667 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119915 Oct 16 00:56:53.402983 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 48/85] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:56:53.436333 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.444626 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.446052 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.447260 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-261aac17-8c61-4417-9331-d1f69cc2b048 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.196505 Oct 16 00:56:53.448098 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 38/86] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:53 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:53.583259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:53.584044 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:53.590613 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.591170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.591677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.592471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.593021 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.593507 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.626471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:53.738904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:53.739511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:53.740433 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.751358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.752696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.752911 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7f8c8a8c-3957-4018-b8ca-4f2dce243ded tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.174188 Oct 16 00:56:53.753993 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.754906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.755590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.756267 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.767498 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 49/87] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:53 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:53.822086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.831351 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a8586912-9436-4aca-881e-70bd13949050 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1218 microversion: 2.1 time: 0.096662 Oct 16 00:56:53.832605 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 39/88] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:53 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:53.839757 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:53.840370 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:53.847086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.847578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.848012 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.848710 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:53.849193 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:53.849617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:53.985026 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:53.998447 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-47ab0c79-4137-451c-b9e4-44d6eb1f1131 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.162418 Oct 16 00:56:53.999070 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 50/89] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:53 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:54.174951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:54.175556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:54.183266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.183956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.184401 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.185115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.185707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.186332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.331048 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:54.340445 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0a75ec90-dea6-4262-8361-a9092b03e44d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.169316 Oct 16 00:56:54.341429 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 40/90] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:54 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:54.474049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:54.475340 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:54.483658 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.484271 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.484798 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.485718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.486309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.486771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.714030 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:54.726570 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:54.729877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:54.731224 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-14ac22af-7490-41f4-8964-fdc69c0702e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.261831 Oct 16 00:56:54.745753 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 51/91] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:54 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:54.776159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:54.776820 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:54.783881 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.784535 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.785022 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.785836 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.786283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.786765 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.856963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:54.857668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:54.868723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.870118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.870734 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:54.871579 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:54.872451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:54.873054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.013182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:55.023646 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1e8a41c2-699f-4fbd-a7ac-c79f5e06a9a6 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1218 microversion: 2.1 time: 0.171777 Oct 16 00:56:55.038904 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 52/92] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:54 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:55.046699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:55.047966 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:55.055023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.055933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.056621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.057841 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.058830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:55.059289 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.060261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.069884 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1c9958c8-5184-4fd2-aac4-55f4d3a3343d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.298107 Oct 16 00:56:55.073652 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 41/93] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:54 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:55.361790 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:55.371943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:55.374169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:55.376363 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4643ea71-a1fb-4791-bae8-0e116cf5fb71 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1315 microversion: 2.1 time: 0.336154 Oct 16 00:56:55.376986 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 53/94] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:55 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:55.393058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.394243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.395369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.397502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.399481 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.402733 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.489295 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b5d739-45c6-406a-a9e6-3f9907102a15", "name": "network-vif-plugged", "status": "completed", "tag": "35acdc7e-ec4e-4155-8024-e8e4f947291d"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:55.505179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.506023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.506624 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.520054 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] Creating event network-vif-plugged:35acdc7e-ec4e-4155-8024-e8e4f947291d for instance 70b5d739-45c6-406a-a9e6-3f9907102a15 on hv-cinder-maste Oct 16 00:56:55.529305 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-e0915c8a-6306-483c-b41f-c8d223739cc5 req-eb712bc7-4608-4d34-a68b-27dee2d72c92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046576 Oct 16 00:56:55.531271 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 54/95] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:56:55.757997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:55.761869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:55.774904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.775821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.779700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.781375 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:55.782361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:55.783457 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:55.831979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:55.840419 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b71271d7-31f0-4a4f-8783-35eb58bd1052 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.480288 Oct 16 00:56:55.841342 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 42/96] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:55 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:56.003372 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.015597 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.017538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.018812 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9b71e78e-cad4-43db-9742-1fbe6a73d76a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.265153 Oct 16 00:56:56.019786 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 55/97] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:55 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:56.055988 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:56.056784 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:56.063496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.064122 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.064753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.065673 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.066254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.066773 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.100796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:56.102731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:56.115206 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.115900 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.116522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.118463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.119169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.120179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.153839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.167137 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e639d188-6417-48a1-831f-1325a2f148c1 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1266 microversion: 2.1 time: 0.114107 Oct 16 00:56:56.169457 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 43/98] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:56 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:56.299163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.307738 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7a5d865e-5004-4189-aa9e-46beff692658 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.212407 Oct 16 00:56:56.309086 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 56/99] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:56 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:56.399850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:56.401248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:56.409067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.409830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.410480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.419963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.420747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.423292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.599986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:56.608094 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-21f13f2b-5c51-420e-9733-ab1e96e0fe02 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1503 microversion: 2.1 time: 0.212350 Oct 16 00:56:56.608669 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 44/100] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:56 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:56.865795 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:56.866974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:56.881707 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.884164 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.884765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:56.885751 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:56.886157 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:56.886594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.044242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:57.045094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:57.056143 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.060287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.063279 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.069374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.070072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.072017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.179599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.189516 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f29aa7c1-d4bb-44e0-bc97-89bf01944443 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.328361 Oct 16 00:56:57.204411 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 57/101] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:56 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:57.222489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:57.223296 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:57.237120 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.237814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.238423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.239438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.240195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.240821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.435996 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.444641 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bec66072-6a3e-4671-904a-ae96b3a9d477 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1266 microversion: 2.1 time: 0.237866 Oct 16 00:56:57.445633 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 58/102] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:57 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:57.451318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:57.452185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:57.459275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.460072 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.460730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.461758 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:57.462369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:57.463568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:57.484921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=100 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:57.493037 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.501613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.503103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.504227 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-774c5fc3-49cb-4def-8317-10283e5f4bd3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.464127 Oct 16 00:56:57.504794 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 45/103] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:57 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:57.661050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:57.672168 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3bad190a-d346-4a65-aace-6a019fc8e26a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.224949 Oct 16 00:56:57.673500 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 59/104] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:57 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:58.129528 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8790822a-765b-47dd-b26a-59ccf7d51d79"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:58.132120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:58.138196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.138687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.139184 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.139868 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.140314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.140911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.228468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:58.229277 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:58.236626 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.237419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.238121 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.239085 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.239638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.240205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.419568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.430638 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-18719db0-8aab-4b05-b989-380efe62c49e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.206547 Oct 16 00:56:58.444862 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 60/105] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:58 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:58.467779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:58.468398 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:58.475016 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.476408 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.477410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.478376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.479148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.479775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.550778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.560150 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4bc3cbbf-2079-47c1-b288-210bd2a49eee tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1266 microversion: 2.1 time: 0.096185 Oct 16 00:56:58.561007 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 61/106] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:58 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:56:58.565622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:58.566190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:58.572219 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.572695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.573235 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.573925 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.574364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.574936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.730338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.739649 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.741121 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.742257 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-132bcd04-fb0f-408a-8edd-21536b5e4bfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.180301 Oct 16 00:56:58.742808 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 62/107] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:58 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:56:58.747372 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:58.748125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:58.754578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.755065 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.755488 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.756262 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:58.756718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:58.757366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:58.902559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:58.911531 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3e31aad2-fc08-4bb7-a6ac-e744802715d8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.167704 Oct 16 00:56:58.912333 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 63/108] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:58 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:59.114352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "name": "network-vif-plugged", "status": "completed", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:56:59.132950 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.133647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.136665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.151161 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] Creating event network-vif-plugged:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:56:59.157015 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-22721d83-3b1d-4de5-b32e-7e30881607f3 req-70a265f7-76fd-411d-add1-c143b126ca75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047455 Oct 16 00:56:59.158287 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 64/109] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:56:59.455860 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:59.456556 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:59.463162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.463767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.464278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.465083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.465848 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.466340 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.623537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:59.633458 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-cfd9d72e-d77a-4d1e-a405-2628996c17d2 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1321 microversion: 2.1 time: 0.181738 Oct 16 00:56:59.634572 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 65/110] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:59 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:59.639910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:59.641271 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:59.648760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.649820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.650253 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.650950 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.651425 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.651991 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.733861 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:59.743169 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a365d18b-1f5e-4212-9973-0397442a0563 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1274 microversion: 2.1 time: 0.107554 Oct 16 00:56:59.744100 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 66/111] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:59 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:56:59.773309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:59.773913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:59.782287 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.782769 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.783397 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.784080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.784674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.785118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.922986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:59.935546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:59.937948 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:56:59.940127 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1a86fbcb-419f-4dc3-b8b9-ea9b0a4c64f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.170908 Oct 16 00:56:59.940699 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 67/112] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:56:59 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:56:59.961385 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:56:59.963776 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:56:59.971447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.971995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.972410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:56:59.973294 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:56:59.973972 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:56:59.974447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:00.200779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=100 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:00.209366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:00.222064 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-55f663fe-a5db-4b00-a16e-625b28d41e2d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.267585 Oct 16 00:57:00.233271 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 68/113] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:56:59 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:00.523971 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1a73b388-7f6b-42ba-b65a-1cca309fd3ef tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "POST /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.398164 Oct 16 00:57:00.530193 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 46/114] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 00:56:58 2022] POST /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5/os-volume_attachments => generated 194 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:00.657744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:00.658353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:00.664966 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:00.665469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:00.665992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:00.666705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:00.667169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:00.667589 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:00.770694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:00.771870 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:00.800764 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:00.801502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:00.802170 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:00.803272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:00.804283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:00.805106 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.080072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.095698 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ad830423-9f62-4a47-905f-2deea17c4b8c tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1272 microversion: 2.1 time: 0.332594 Oct 16 00:57:01.096449 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 47/115] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:00 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:01.102306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:01.103211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:01.110644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.111341 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.111772 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.112464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.112944 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.113361 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.144156 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.152143 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d6e4c30b-a86e-4868-b877-fcb2db98af07 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1516 microversion: 2.1 time: 0.498441 Oct 16 00:57:01.152742 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 69/116] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:00 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:01.175461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:01.177958 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:01.184885 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.185392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.185840 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.186533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.187640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.188074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.250110 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lazy-loading 'flavor' on Instance uuid 70b5d739-45c6-406a-a9e6-3f9907102a15 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 00:57:01.291581 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.300149 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.301731 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.303055 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-afae724b-fd6b-441a-931b-fc7d912fce8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.205367 Oct 16 00:57:01.303600 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 48/117] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:57:01 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:57:01.308140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:01.308945 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:01.315663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.316145 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.316580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.317293 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.317744 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.318159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.387648 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-89831a70-641e-4a60-b3c3-b8a2afd9fffd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15/action" status: 200 len: 32 microversion: 2.1 time: 0.215918 Oct 16 00:57:01.388405 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 70/118] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 00:57:01 2022] POST /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 00:57:01.399334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:01.400038 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:01.406696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.407237 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.407726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.408597 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:01.408898 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:01.409323 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:01.570883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.580751 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-10bb9752-d527-4dfa-8254-c60c78ca6562 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.275930 Oct 16 00:57:01.582593 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 49/119] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:01 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:01.706830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:01.714903 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-12af09ee-3ffa-4359-908e-1cb763fc1ce3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.320531 Oct 16 00:57:01.715647 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 71/120] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:01 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:02.121753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:02.121753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:02.126742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.126906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.127419 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.128194 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.128790 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.129231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.285699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.293721 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2fb181cd-cfa3-4111-836a-d9567379d43e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.178401 Oct 16 00:57:02.294283 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 50/121] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:02 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:02.327487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:02.328088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:02.330180 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=100 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:02.335371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.335846 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.336276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.337006 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.337453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.337865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.475099 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.484552 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.486119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.487360 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1731637c-e395-400e-bf17-58275f533707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.163904 Oct 16 00:57:02.487917 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 72/122] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:57:02 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:57:02.606459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:02.607134 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:02.609425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:02.610596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:02.616689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.617238 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.617723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.618480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.618964 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.619428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.739517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:02.740227 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:02.742268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:02.747745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.748236 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.748676 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.749423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:02.749915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:02.750355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:02.754641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.762530 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-78a6d282-ce62-4e8f-8037-40c769fd74ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.160028 Oct 16 00:57:02.763127 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 51/123] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:02 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:02.883597 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:02.891431 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7198eca2-a6f4-4524-ba14-af7a8110842f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.155824 Oct 16 00:57:02.892007 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 73/124] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:02 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:03.318746 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:03.319683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:03.326442 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.326924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.327358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.328046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.328657 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.329312 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.464360 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:03.472746 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3cf63054-8730-40af-9111-14f4f2f32a74 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.159911 Oct 16 00:57:03.477269 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 52/125] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:03 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:03.520934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:03.521758 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:03.528165 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.528724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.529307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.530129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.530620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.531163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.673545 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:03.676100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:03.685713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:03.688218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:03.689402 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-92131038-20cf-4b87-9c56-03f924b6fb17 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.174857 Oct 16 00:57:03.690410 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 74/126] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:57:03 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:57:03.794872 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:03.795787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:03.802455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.803038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.803712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.804612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.805252 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.805994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.914349 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:03.915087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:03.929231 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.932316 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.933496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:03.934219 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:03.940204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:03.941878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:04.068470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:04.078011 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0b98be10-eebd-4e1d-a494-4d1b47bb391d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.289729 Oct 16 00:57:04.096901 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 53/127] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:03 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:04.257936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:04.270007 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c861590a-7210-4835-b655-bea3eb5a97b4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.359783 Oct 16 00:57:04.270783 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 75/128] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:03 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:04.501309 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:04.501968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:04.518311 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:04.519286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:04.519999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:04.521595 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:04.522292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:04.523153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:04.715253 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:04.716046 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:04.725677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:04.727137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:04.729288 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:04.731595 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:04.733210 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:04.733793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:04.865062 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:04.876368 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-94d15fb3-c5dc-4739-a240-c122555be89a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.384199 Oct 16 00:57:04.877040 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 54/129] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:04 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:05.070961 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:05.080799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:05.082269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:05.083411 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ffe02aee-ec3c-47d3-931e-34c5881b6487 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1406 microversion: 2.20 time: 0.373442 Oct 16 00:57:05.083973 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 76/130] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:57:04 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:57:05.118632 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:05.120811 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:05.134988 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.136976 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.137485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.139868 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.140812 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.142259 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.265639 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98", "tag": "72e1e381-2341-49b9-91a0-7a86468423f6"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:05.289852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.291469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.292161 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.328674 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] Creating event network-changed:72e1e381-2341-49b9-91a0-7a86468423f6 for instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 on hv-cinder-maste Oct 16 00:57:05.345651 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-53c4fbe7-fee1-4e27-9e76-5044020e891c req-5021e9bd-371f-4d91-9065-211c5c11bfcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082206 Oct 16 00:57:05.346843 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 77/131] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:57:05.364032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:05.366609 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:05.380765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.382470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.383943 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.386000 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.387399 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.391880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.506861 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:05.516885 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cd941081-8496-4c01-8a5d-b8964e135d8e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.404338 Oct 16 00:57:05.521103 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 55/132] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:05 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:05.650077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:05.658312 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3cb9d285-70e4-4a85-b374-8aca585c4368 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.307727 Oct 16 00:57:05.659227 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 78/133] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:05 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:05.899309 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:05.900155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:05.909805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.910402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.910839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:05.911536 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:05.913171 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:05.914926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.109804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:06.110409 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:06.128974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.129971 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.130473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.131148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.131604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.132029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.289538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:06.301969 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b057b774-52b6-4b51-bf06-9bd39c1c932e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.405044 Oct 16 00:57:06.302815 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 56/134] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:05 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:06.389731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:06.402461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:06.403997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:06.406174 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d3f00cee-be4c-41ab-8c0c-e91a44259a54 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1597 microversion: 2.20 time: 0.300385 Oct 16 00:57:06.406909 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 79/135] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:57:06 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1597 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:57:06.432977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:06.433492 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:06.441520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.446900 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.451409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.452374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.455585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.456469 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.542454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:06.543204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:06.553052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.553564 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.554001 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.554713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.555167 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.555590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.582066 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1a8d3a21-d521-43cf-b66e-f79abc00ef39 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153033 Oct 16 00:57:06.582845 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 57/136] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 16 00:57:06 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:57:06.684105 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:06.685041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:06.692320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.693356 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.694067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:06.695026 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:06.695682 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:06.696345 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:07.738653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:07.746626 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b4fcb948-1849-4c5e-9149-fd85d375880c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 1.208471 Oct 16 00:57:07.747223 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 80/137] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:06 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:07.758626 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:07.759107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:07.774793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:07.775291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:07.775730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:07.776530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:07.777047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:07.777640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:07.808495 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 00:57:07.890918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:07.902386 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0e3c6729-feb9-43bc-950b-da03d3a06e2b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 1.222251 Oct 16 00:57:07.903183 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 58/138] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:06 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:07.913644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:07.915509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:07.957380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:07.957723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:07.958148 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:07.958848 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:07.959297 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:07.959710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:07.979389 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6e9666bd-222a-4180-8327-78972674b6d6 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 204 len: 0 microversion: 2.1 time: 0.230407 Oct 16 00:57:07.981204 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 81/139] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 00:57:07 2022] DELETE /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 00:57:07.991217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630316f0-8515-4ba3-b433-29c96907a8b2", "name": "network-vif-plugged", "status": "completed", "tag": "a781e62b-4499-48b4-bb7f-86dce780562d"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:08.003496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.004666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.006060 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.022263 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] Creating event network-vif-plugged:a781e62b-4499-48b4-bb7f-86dce780562d for instance 630316f0-8515-4ba3-b433-29c96907a8b2 on hv-cinder-maste Oct 16 00:57:08.027817 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-7b3c0dd4-6941-4e96-a46d-7db5a79b9335 req-38f3a300-deef-43fe-9a48-8ef37ae394de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043534 Oct 16 00:57:08.029090 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 82/140] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:08.036117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:08.037986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:08.045315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.046056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.046691 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.047772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.048482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.048997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.404782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:08.414246 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-35c86d96-65ea-4b1d-9205-e9ee010886cb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.507862 Oct 16 00:57:08.414832 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 59/141] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:07 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:08.465314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:08.479557 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b08d012c-1b2e-4554-96f5-fa8da279b2ea tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1555 microversion: 2.1 time: 0.448974 Oct 16 00:57:08.480714 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 83/142] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:08 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1555 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:08.770735 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:08.771469 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:08.778846 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.779376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.783242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.785397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.785938 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.786377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.931358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:08.932119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:08.940128 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.940875 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.941509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:08.942842 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:08.943446 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:08.944014 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.317152 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:09.324797 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-adfde4e6-32cc-49b9-946d-391ecc53670b tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.558369 Oct 16 00:57:09.325396 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 60/143] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:08 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:09.339726 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:09.343302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:09.351999 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-56e0b58c-fc9b-4fbf-abea-05856176c0bf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.425688 Oct 16 00:57:09.364009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:09.364009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:09.364009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.369863 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 84/144] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:08 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:09.385458 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] Creating event network-changed:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:57:09.392526 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-f28e19e7-8740-4639-b975-e63346d57636 req-d836e073-f060-4e2b-bfbf-f6b06598d355 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065996 Oct 16 00:57:09.393355 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 61/145] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:09.444778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:09.445417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:09.453592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:09.454417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:09.454993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.456020 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:09.456675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:09.457266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.511176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:09.516551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:09.540493 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:09.543053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:09.543739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.546560 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:09.550820 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:09.551558 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:09.850438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:09.869221 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-10c755b6-c99e-4662-9a8e-0a0d607c6702 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.429144 Oct 16 00:57:09.876876 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:09.878718 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 85/146] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:09 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:09.886444 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9251f947-eb34-45db-b694-a9371d519757 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1555 microversion: 2.1 time: 0.385297 Oct 16 00:57:09.887184 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 62/147] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:09 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1555 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:10.348125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:10.348801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:10.364092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.366004 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.369174 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.375604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.376349 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.377036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.377599 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:10.378227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:10.387678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.388165 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.390578 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.391300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.391767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.395813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.435292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:10.664204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:10.676984 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-34971ae3-3d44-4710-a537-4ce110c43ba0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.333174 Oct 16 00:57:10.677571 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 86/148] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:10 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:10.748806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:10.759703 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a48575c0-8bdb-4ba1-9d7c-5b78e33f838c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.385916 Oct 16 00:57:10.760609 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 63/149] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:10 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:10.901252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:10.902175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:10.909801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:10.910506 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:10.910806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.911376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.911926 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.912741 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.913368 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.913799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.917584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.920232 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.920711 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:10.922031 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:10.926857 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:10.927595 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:11.135934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:11.146643 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-feb7b6e8-5c7f-4bb1-aa27-621e68f4bcbe tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.249603 Oct 16 00:57:11.147438 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 87/150] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:10 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:11.153860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:11.171433 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ebc795f9-3079-4894-994f-1ea0eb24690a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1555 microversion: 2.1 time: 0.264434 Oct 16 00:57:11.172185 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 64/151] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:10 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:11.699845 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:11.701326 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:11.708168 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:11.708820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:11.709467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:11.710523 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:11.711309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:11.711941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:11.785456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:11.786074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:11.792792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:11.793327 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:11.793942 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:11.797055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:11.797055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:11.797055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:11.950835 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:11.959050 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c03ffff3-f296-40e7-980f-812ae7a57d2a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.263174 Oct 16 00:57:11.959634 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 88/152] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:11 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:12.026757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:12.035714 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d38afcaf-99d7-4232-8fa1-186003c03bb9 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.254390 Oct 16 00:57:12.036408 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 65/153] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:11 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:12.175183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:12.175984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:12.183659 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.184150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.184646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:12.185448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.185907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.186328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:12.196390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:12.197100 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:12.205670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.206374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.207197 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:12.208626 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.209555 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.210455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:12.420029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:12.424555 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:12.428635 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-af0a48de-4893-495d-b76c-7785d755e4a0 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.259170 Oct 16 00:57:12.429179 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 89/154] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:12 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:12.434924 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-13ecb865-3f56-4edf-9377-a83a2ff74f3b tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1555 microversion: 2.1 time: 0.244177 Oct 16 00:57:12.435836 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 66/155] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:12 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:12.982582 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:12.983199 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:12.990300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.990803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.991227 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:12.991924 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:12.992554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:12.993108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.061054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:13.061666 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:13.073596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.074074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.074509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.075212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.075657 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.076140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.193113 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:13.204798 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-43754d87-fc7f-4616-b526-fc731745bef3 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1363 microversion: 2.1 time: 0.226312 Oct 16 00:57:13.208104 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 90/156] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:12 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:13.333950 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:13.345617 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-47e904e9-bd6a-43cc-b5b6-80323cdc8a98 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.288473 Oct 16 00:57:13.349674 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 67/157] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:13 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:13.450873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:13.453764 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:13.460049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:13.460246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:13.467506 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.468344 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.470720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.471664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:13.471909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.473049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.474355 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.475194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.476002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.477920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.480474 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:13.484332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:13.485538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:13.549704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:13.897735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:13.916354 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-213cc6bf-b4fd-482c-b928-6f15d55db2ec tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.469199 Oct 16 00:57:13.917295 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 91/158] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:13 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:13.942307 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:13.960535 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fcd4d4a2-6fd4-43a0-bedc-f032f1ce8a47 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1555 microversion: 2.1 time: 0.505579 Oct 16 00:57:13.974400 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 68/159] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:13 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1555 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:14.232599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:14.233880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:14.248269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.248789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.250680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.254266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.254835 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.255273 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.375621 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:14.376277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:14.385272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.386054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.386757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.387631 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.388277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.389002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.624793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:14.648026 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-930f743f-3697-4eac-bbc9-062dac1599c8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1549 microversion: 2.1 time: 0.422302 Oct 16 00:57:14.649339 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 92/160] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:14 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1549 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:14.654983 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46db3fd-ce68-4a8b-a238-89d710f6eef5", "name": "network-vif-deleted", "tag": "2303cb8c-5ee9-469c-a4fc-cce088e0cbc4"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:14.657326 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:14.680975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.682123 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c1cbb0d7-c1c3-40b7-a745-87f60a564047 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.296632 Oct 16 00:57:14.682724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.683490 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 69/161] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:14 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:14.684305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.695242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:14.695654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:14.712737 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.713259 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.713832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.715300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.715750 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.716795 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] Creating event network-vif-deleted:2303cb8c-5ee9-469c-a4fc-cce088e0cbc4 for instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 on hv-cinder-maste Oct 16 00:57:14.717147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.722874 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-ab7c514a-3f18-4d07-8cc6-61389ad5884d req-ebff2ccf-96f9-4612-8ef3-c942ca033497 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072035 Oct 16 00:57:14.723760 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 93/162] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:14.805265 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2b9d13d6-2878-460c-a57f-a7eb5dd1f2ef tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116799 Oct 16 00:57:14.806385 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 70/163] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 00:57:14 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:14.946455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:14.947212 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:14.953505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.954491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.954914 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.955658 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:14.956113 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:14.956682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:14.993495 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:14.994529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:15.006805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:15.007308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:15.008014 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:15.009361 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:15.010061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:15.010694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:15.127550 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:15.141574 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-286360bc-8436-4035-8bd8-1e6e95fc8b3e tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1346 microversion: 2.1 time: 0.156929 Oct 16 00:57:15.144125 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 71/164] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:14 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:15.267097 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:15.274693 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-be3fe340-1046-4857-a64b-3df599c2a767 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.332491 Oct 16 00:57:15.275258 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 94/165] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:14 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:15.707804 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:15.708539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:15.719971 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:15.720255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:15.720697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:15.723291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:15.739826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:15.739826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:15.956847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:15.972631 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a5cf5c31-4fd2-4156-be9f-a01ef27b9b63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.268917 Oct 16 00:57:15.975810 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 72/166] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:15 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:16.162369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630316f0-8515-4ba3-b433-29c96907a8b2", "tag": "a781e62b-4499-48b4-bb7f-86dce780562d"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:16.167875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:16.168682 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:16.179242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.180507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.181461 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.182403 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.183177 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.183735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.184115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.184387 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.184803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.211244 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] Creating event network-changed:a781e62b-4499-48b4-bb7f-86dce780562d for instance 630316f0-8515-4ba3-b433-29c96907a8b2 on hv-cinder-maste Oct 16 00:57:16.227439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.228318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.229067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.229903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lazy-loading 'fault' on Instance uuid e46db3fd-ce68-4a8b-a238-89d710f6eef5 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 00:57:16.238209 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-4cafe310-15f0-49f8-8fcc-51f1f5083dad req-b9caab6f-18f3-43c5-9516-6fab601b4997 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079328 Oct 16 00:57:16.238848 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 95/167] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:16.253126 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98", "name": "network-vif-plugged", "status": "completed", "tag": "72e1e381-2341-49b9-91a0-7a86468423f6"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:16.274722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.275415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.275598 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.299748 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] Creating event network-vif-plugged:72e1e381-2341-49b9-91a0-7a86468423f6 for instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 on hv-cinder-maste Oct 16 00:57:16.309724 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-dde76472-719c-48b3-b7a5-b9e4cfe3f08f req-65215551-7d46-487e-a572-0f6cd9e01eb0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060461 Oct 16 00:57:16.311879 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aca3737ea4c40a89384bdf5e77d90f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:16.315696 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 96/168] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:57:16.323832 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:16.324539 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:16.332602 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-302f5829-1d7d-4606-8d09-80bca24246fe tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 200 len: 1351 microversion: 2.1 time: 0.169678 Oct 16 00:57:16.338671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.340007 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.340684 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.342520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:16.343170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:16.343831 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:16.352445 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 73/169] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:16 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 1351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:16.577023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:16.587043 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0f8737d5-f7dc-4547-8ed4-2f1557576b7e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.268945 Oct 16 00:57:16.588173 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 97/170] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:16 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:16.998740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:17.000033 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:17.006664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.007269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.007792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.008561 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.009220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.009732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.358671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:17.360507 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:17.368824 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.369605 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.370444 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.371592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.372680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.373383 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.393252 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] HTTP exception thrown: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Request method failure captured: Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 HTTP/1.1 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1atWs_bcb3c2JgDPJvilegwk14V_jL1kvnxFLNr0bgLdFrCUM0z-vlbDUDY2HOiGzhlIe48tphsW7W1P2P2qA93GugTpD-i3lunHzGKFy5Ij7l9ZlfVAp0PrNfSO4lmzTQoBR0N41MK_kdjZthiwaQ5zUazGE42fCfeGYPKTZCDWWU Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 00:57:17.400182 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9ecfb8b74ec4e03bc149b1e1b56c356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}] Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 3aca3737ea4c40a89384bdf5e77d90f5 Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.401667 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'e46db3fd-ce68-4a8b-a238-89d710f6eef5'} Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:57:17.402341 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.403663 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.404706 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Returning 404 to user: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:57:17.404706 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5437c505-2ca8-47b7-b866-587f921205b5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 404 len: 111 microversion: 2.1 time: 0.050522 Oct 16 00:57:17.404706 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 98/171] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:17 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:17.422910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:17.430655 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-45a08b04-0411-406e-af34-a202d1649a80 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.435736 Oct 16 00:57:17.433374 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 74/172] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:16 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:17.605545 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:17.615216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:17.616891 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:17.621247 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:17.631384 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.631936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.640316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.641450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.644576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.645086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.645521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.646213 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:17.647247 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.647672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.661985 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:17.661985 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:17.676242 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] HTTP exception thrown: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Request method failure captured: Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5/os-volume_attachments HTTP/1.1 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1atWs_bcb3c2JgDPJvilegwk14V_jL1kvnxFLNr0bgLdFrCUM0z-vlbDUDY2HOiGzhlIe48tphsW7W1P2P2qA93GugTpD-i3lunHzGKFy5Ij7l9ZlfVAp0PrNfSO4lmzTQoBR0N41MK_kdjZthiwaQ5zUazGE42fCfeGYPKTZCDWWU Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 00:57:17.694133 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9ecfb8b74ec4e03bc149b1e1b56c356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}] Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 3aca3737ea4c40a89384bdf5e77d90f5 Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.695713 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'server_id': 'e46db3fd-ce68-4a8b-a238-89d710f6eef5'} Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:57:17.696393 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:17.701140 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:17.702434 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Returning 404 to user: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:57:17.702434 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-82f38ad1-e4cc-4cf0-941f-6994d632947f tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.095060 Oct 16 00:57:17.702434 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 99/173] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 00:57:17 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:17.805826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:17.814009 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5f419f00-a0ed-4afc-981f-5fed5e3b7b77 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.205550 Oct 16 00:57:17.814652 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 75/174] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:17 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:18.458899 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:18.459936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:18.468827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.469354 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.469795 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.470477 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.470926 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.471328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.621556 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:18.633641 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-36433544-33c7-4d3e-8afd-dd396e33630b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.181004 Oct 16 00:57:18.634206 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 100/175] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:18 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:18.838002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:18.839134 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:18.846242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.846496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.847006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.847698 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.848137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.848714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.925018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:18.925739 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:18.934787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.935525 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.936273 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.937139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.938169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.938915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.954444 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] HTTP exception thrown: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Request method failure captured: Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: DELETE /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 HTTP/1.1 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1atWs_bcb3c2JgDPJvilegwk14V_jL1kvnxFLNr0bgLdFrCUM0z-vlbDUDY2HOiGzhlIe48tphsW7W1P2P2qA93GugTpD-i3lunHzGKFy5Ij7l9ZlfVAp0PrNfSO4lmzTQoBR0N41MK_kdjZthiwaQ5zUazGE42fCfeGYPKTZCDWWU Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 00:57:18.956469 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9ecfb8b74ec4e03bc149b1e1b56c356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}] Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 3aca3737ea4c40a89384bdf5e77d90f5 Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:18.957886 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'e46db3fd-ce68-4a8b-a238-89d710f6eef5'} Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:57:18.958762 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:18.959955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:18.962496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Returning 404 to user: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:57:18.963491 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-457aa5c6-16b0-4085-9d80-3142efc600e5 tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 404 len: 111 microversion: 2.1 time: 0.043994 Oct 16 00:57:18.965466 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 101/176] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 00:57:18 2022] DELETE /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:18.974290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:18.975171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] [instance: e46db3fd-ce68-4a8b-a238-89d710f6eef5] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:18.983279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.984265 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.984703 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:18.985746 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:18.986473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:18.987080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:19.002610 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] HTTP exception thrown: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Request method failure captured: Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 HTTP/1.1 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1atWs_bcb3c2JgDPJvilegwk14V_jL1kvnxFLNr0bgLdFrCUM0z-vlbDUDY2HOiGzhlIe48tphsW7W1P2P2qA93GugTpD-i3lunHzGKFy5Ij7l9ZlfVAp0PrNfSO4lmzTQoBR0N41MK_kdjZthiwaQ5zUazGE42fCfeGYPKTZCDWWU Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 00:57:19.004484 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9ecfb8b74ec4e03bc149b1e1b56c356", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9ecfb8b74ec4e03bc149b1e1b56c356"}]}] Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: f9ecfb8b74ec4e03bc149b1e1b56c356 Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1776134627 Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 3aca3737ea4c40a89384bdf5e77d90f5 Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-DeleteServersTestJSON-1776134627-project Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:19.005883 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'e46db3fd-ce68-4a8b-a238-89d710f6eef5'} Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:57:19.006681 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. Oct 16 00:57:19.007943 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 00:57:19.009120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:19.010120 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] Returning 404 to user: Instance e46db3fd-ce68-4a8b-a238-89d710f6eef5 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:57:19.010971 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-16f263ed-cd65-406e-87a6-b70dd94a693a tempest-DeleteServersTestJSON-1776134627 tempest-DeleteServersTestJSON-1776134627-project] 10.222.0.13 "GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5" status: 404 len: 111 microversion: 2.1 time: 0.041837 Oct 16 00:57:19.011701 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 102/177] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:18 2022] GET /compute/v2.1/servers/e46db3fd-ce68-4a8b-a238-89d710f6eef5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 00:57:19.019932 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ed0b658a-10d6-4910-9bac-4096ffdca2ae tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1314 microversion: 2.1 time: 0.185274 Oct 16 00:57:19.020536 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 76/178] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:18 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:19.656800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:19.658304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:19.666150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:19.667087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:19.667763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:19.668601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:19.669521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:19.670260 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:19.901357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:19.914038 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-09574d7b-46aa-4d5d-b10b-406be9203eb3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.260970 Oct 16 00:57:19.915193 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 103/179] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:19 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:20.044208 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:20.046550 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:20.055664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:20.056800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:20.057647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:20.059561 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:20.060554 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:20.061275 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:20.228793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:20.242250 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d0bfdb0d-4c1a-4740-ba22-171567e72486 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1499 microversion: 2.1 time: 0.203129 Oct 16 00:57:20.243354 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 77/180] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:20 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:20.943939 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:20.946812 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:20.954621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:20.956358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:20.957993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:20.959123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:20.959830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:20.960464 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:21.195714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:21.208318 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-eaf8e2fb-14dd-430d-82e3-15b077db97e5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.271595 Oct 16 00:57:21.216915 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 104/181] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:20 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:22.233389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:22.235121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:22.247087 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:22.247800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:22.248402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:22.249316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:22.250866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:22.251556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:22.755497 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:22.765049 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-abb5ba1e-4a3d-4c6b-8348-d1dda663673e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.535818 Oct 16 00:57:22.766025 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 78/182] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:22 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:23.789508 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:23.790502 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:23.806149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:23.808753 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:23.811095 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:23.814713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:23.815422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:23.817029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:24.043837 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:24.044435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:24.066287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:24.067013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:24.068999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:24.072048 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:24.072889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:24.073470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:24.102294 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:24.106993 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 00:57:24.114476 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4cc9b1d0-9ff2-4aa0-9d3b-fcd5861f127a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.330654 Oct 16 00:57:24.117343 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 105/183] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:23 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:24.165205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=100 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:24.294404 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-dcbb465e-8fb0-4ac9-bbc3-030b0bcd0a0a tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 204 len: 0 microversion: 2.1 time: 0.255788 Oct 16 00:57:24.295002 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 79/184] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 00:57:24 2022] DELETE /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 00:57:24.303770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:24.304686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:24.311934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:24.312651 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:24.313250 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:24.314122 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:24.314893 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:24.315466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:24.480094 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:24.492186 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-54b7dbd4-969f-41c8-b39f-7b1e554b995e tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1505 microversion: 2.1 time: 0.191980 Oct 16 00:57:24.494860 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 106/185] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:24 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:25.140115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:25.140801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:25.152368 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:25.152898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:25.153508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:25.154449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:25.155141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:25.155712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:25.315508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:25.328819 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-16c10a4c-ff32-40dd-a9a3-f309b6a0b0c3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.192182 Oct 16 00:57:25.329617 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 80/186] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:25 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:25.523339 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:25.523959 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:25.529961 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:25.530627 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:25.531218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:25.531898 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:25.532534 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:25.533183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:25.748806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:25.763781 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2fef74ff-5e7f-428c-802f-baf723b68d57 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1505 microversion: 2.1 time: 0.243908 Oct 16 00:57:25.764876 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 107/187] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:25 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:26.352777 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:26.353510 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:26.360386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:26.360983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:26.361483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:26.362243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:26.362759 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:26.363244 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:26.608074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:26.617970 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-bba16cd8-08a4-4522-b479-4004343a3a83 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.269176 Oct 16 00:57:26.618751 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 81/188] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:26 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:26.795696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:26.796613 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:26.804738 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:26.805366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:26.806128 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:26.806990 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:26.807455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:26.807944 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:27.270260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98", "name": "network-vif-deleted", "tag": "72e1e381-2341-49b9-91a0-7a86468423f6"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:27.274285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:27.286638 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-14185cb8-5a81-4274-9e76-ab20dcf21621 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1505 microversion: 2.1 time: 0.501055 Oct 16 00:57:27.289216 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 108/189] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:26 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:27.307220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:27.307712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:27.308144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:27.323820 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] Creating event network-vif-deleted:72e1e381-2341-49b9-91a0-7a86468423f6 for instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 on hv-cinder-maste Oct 16 00:57:27.337634 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-1c1c163c-45d2-43b9-b7e9-93cf5518366c req-734569ff-8051-4a68-ab5d-b4245f8a019b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065732 Oct 16 00:57:27.337634 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 82/190] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:57:27.644364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:27.645371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:27.660003 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:27.663447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:27.666006 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:27.668113 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:27.670630 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:27.673702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:27.996170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:28.007799 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-27fbc69a-936a-4177-b4de-e33ee8535de8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.369905 Oct 16 00:57:28.008978 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 109/191] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:27 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:28.315901 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:28.317127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:28.328349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:28.333510 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:28.338544 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:28.339664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:28.341955 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:28.342381 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:28.416361 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:28.417197 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:28.418109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:28.418928 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lazy-loading 'fault' on Instance uuid 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 00:57:28.560954 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44fd5c928ea4a4289f24e6b825b98fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925b11e4612b49f88fa6812d55e15c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:28.580599 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-644a2a4f-7337-4e23-8c66-6ba362b58944 tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 200 len: 1304 microversion: 2.1 time: 0.272748 Oct 16 00:57:28.582556 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 83/192] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:28 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 1304 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:29.032568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:29.034012 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:29.041355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:29.042083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:29.042526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:29.043202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:29.043801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:29.044272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:29.259787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:29.272620 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3d6798e6-ccc9-438d-b958-627293c82791 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.244494 Oct 16 00:57:29.273474 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 110/193] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:29 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:29.608126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:29.608819 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] [instance: 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:29.616787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:29.618176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:29.618809 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:29.619979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:29.621078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:29.621670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:29.639344 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] HTTP exception thrown: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Request method failure captured: Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 HTTP/1.1 Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1bOefP1oGgR-1zUATOGhQKs3xP1L6X35AuVo4gCitJa9PobyIEhVfzvvE1wS0UTmGnQM8JuhM38dkvzx9cRcsH6H_fb26rzGATrXGxXPjGXzD6rSu4DAUsPyK6TggwC-MK6yYokyj5c8XMDLtMnYvZu4-1Hsk1GxeW1oiwBf-SjdQQ Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 925b11e4612b49f88fa6812d55e15c0c Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesActionsTest-216519116 Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 00:57:29.646451 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_925b11e4612b49f88fa6812d55e15c0c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/925b11e4612b49f88fa6812d55e15c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/925b11e4612b49f88fa6812d55e15c0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/925b11e4612b49f88fa6812d55e15c0c"}]}] Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesActionsTest-216519116 Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 925b11e4612b49f88fa6812d55e15c0c Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesActionsTest-216519116 Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesActionsTest-216519116-project Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: b44fd5c928ea4a4289f24e6b825b98fa Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesActionsTest-216519116-project Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. Oct 16 00:57:29.647989 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98'} Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:57:29.648801 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. Oct 16 00:57:29.650350 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:57:29.653212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] Returning 404 to user: Instance 9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:57:29.655259 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fa8bbef7-9484-423d-8e2a-2e70d5505fdb tempest-VolumesActionsTest-216519116 tempest-VolumesActionsTest-216519116-project] 10.222.0.13 "GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98" status: 404 len: 111 microversion: 2.1 time: 0.051295 Oct 16 00:57:29.659600 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 84/194] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:29 2022] GET /compute/v2.1/servers/9c1e7b07-fa3e-4300-8d1a-343ea9c5cf98 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 00:57:30.297660 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:30.298418 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:30.305174 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:30.305984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:30.306625 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:30.307547 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:30.308199 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:30.308818 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:30.529412 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:30.537619 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4486eb2b-9c51-405e-80c0-4b3b9c10a63d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.244511 Oct 16 00:57:30.538343 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 111/195] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:30 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:31.563915 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:31.565161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:31.572814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:31.573576 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:31.574464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:31.575542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:31.576266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:31.576948 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:31.756853 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:31.766178 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f4914ae4-905d-4c92-8f98-c29b2fb3eefa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.207402 Oct 16 00:57:31.781667 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 85/196] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:31 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:31.829382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-01bfe8d3-d4a5-43a0-82f9-b852c35dd1a6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: .version_select at 0x7f58070ed5e0>, body: {"keypair": {"name": "tempest-keypair-2058823314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHeIwHNTuHs50yTfgRtZZ80hVzTk4E19SrtYHzAiQZYq/oreHrEigJjTJF84cLWzLD6JJiFCjCZgycGtO+A3dir88RtprXO5vU8ju/Df2dp+23V+EEKloDRpnA5s40tg=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:31.847136 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-01bfe8d3-d4a5-43a0-82f9-b852c35dd1a6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:57:31.853852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-01bfe8d3-d4a5-43a0-82f9-b852c35dd1a6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:57:31.881671 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-01bfe8d3-d4a5-43a0-82f9-b852c35dd1a6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.199944 Oct 16 00:57:31.882571 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 112/197] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 00:57:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:57:32.791785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:32.792397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:32.799515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:32.800001 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:32.800428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:32.801331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:32.801786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:32.802200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:32.944607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:32.952866 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-60c961b4-4d44-41de-aba1-d6a35f5a8c27 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.165082 Oct 16 00:57:32.953468 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 86/198] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:32 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:33.420518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1377459806", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3913489d-de8f-457c-b3d2-8d2ca6fdbe30"}], "security_groups": [{"name": "tempest-securitygroup--31226411"}], "key_name": "tempest-keypair-2058823314", "user_data": "}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:33.434836 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:33.547854 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] validate_networks() for [('3913489d-de8f-457c-b3d2-8d2ca6fdbe30', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:57:33.975964 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:33.977629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:33.993169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:33.993662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:33.994098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:33.994807 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:33.995414 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:33.995819 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:34.404629 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:57:34.405466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:57:34.405960 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:57:34.406399 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:57:34.406894 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:57:34.417181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:34.418028 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:34.418638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:34.420330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:34.420774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:34.421348 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:34.451479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:57:34.463318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:57:34.464037 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:34.477318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:57:34.479664 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:57:34.500325 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4343bb18-ed42-42c6-b55d-696d7f726be5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.517850 Oct 16 00:57:34.514490 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 87/199] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:33 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:34.550539 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c351b3d7-5ace-4d62-aa6f-fbc7be48e1ef tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.134889 Oct 16 00:57:34.552175 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 113/200] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:57:33 2022] POST /compute/v2.1/servers => generated 400 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:57:34.567248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48c3f8eb-e8ca-4e8c-a582-1d6b683545cc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:34.567875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-48c3f8eb-e8ca-4e8c-a582-1d6b683545cc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:34.632013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-48c3f8eb-e8ca-4e8c-a582-1d6b683545cc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:34.647799 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-48c3f8eb-e8ca-4e8c-a582-1d6b683545cc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1242 microversion: 2.1 time: 0.085655 Oct 16 00:57:34.648584 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 88/201] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:34 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:35.531270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:35.532742 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:35.545123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:35.545745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:35.546487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:35.547411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:35.548054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:35.549047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:35.610695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=100 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:35.684286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:35.685910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:35.700277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:35.701779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:35.703685 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:35.704616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:35.705204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:35.705858 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:35.789793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:35.802741 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-153376d7-7221-40f8-94bd-c14bf2439853 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.279696 Oct 16 00:57:35.803341 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 114/202] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:35 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:35.811501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:35.825696 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d0ad00ad-a0eb-4119-bfa3-5ab5a828effe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1294 microversion: 2.1 time: 0.158361 Oct 16 00:57:35.826831 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 89/203] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:35 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:57:36.827636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:36.828600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:36.836067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:36.837098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:36.837628 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:36.841937 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:36.842406 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:36.842851 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:36.852119 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:36.852878 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:36.863980 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:36.864539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:36.865127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:36.865889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:36.866402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:36.866882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:36.990098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:36.999284 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cd4325f0-4801-49d2-baef-248ffeb9a07e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1300 microversion: 2.1 time: 0.151250 Oct 16 00:57:36.999878 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 90/204] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:36 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:37.037093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:37.046059 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4fb31c60-7525-4187-9f00-3f858eb6ee87 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.222824 Oct 16 00:57:37.046753 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 115/205] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:36 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:38.022936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:38.023507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:38.033530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:38.034032 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:38.034470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:38.037935 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:38.038431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:38.038874 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:38.071548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:38.073584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:38.088893 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:38.089656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:38.090307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:38.093758 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:38.094325 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:38.095179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:38.340953 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:38.342734 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2bd05790-9737-4c96-81fd-0bb4ff8c283b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.323416 Oct 16 00:57:38.343719 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:38.344117 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 91/206] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:38 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:38.353050 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9f2d5c55-1825-47c2-ba48-72e2dfba019a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.287619 Oct 16 00:57:38.367265 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 116/207] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:38 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:38.375373 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511846b5-6613-4b20-8550-31b4067e1da2", "tag": "3e27aa79-19be-43f6-92b8-258048ba4a37"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:38.386088 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:38.386763 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:38.387333 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:38.399648 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] Creating event network-changed:3e27aa79-19be-43f6-92b8-258048ba4a37 for instance 511846b5-6613-4b20-8550-31b4067e1da2 on hv-cinder-maste Oct 16 00:57:38.405212 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-4a1c6a2e-fdf7-4806-ae8e-41a31aed3a1f req-3b81dcea-c315-4a5d-a65c-5948593f5a8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059723 Oct 16 00:57:38.406650 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 92/208] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:39.377667 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:39.378207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:39.382814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:39.383520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:39.384736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:39.385260 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:39.385687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:39.386404 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:39.386877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:39.387284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:39.390004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:39.390485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:39.390917 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:39.391607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:39.392055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:39.392498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:39.584000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:39.587284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:39.593993 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0889c692-69ee-4a71-9e30-22a8f96c156f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.215951 Oct 16 00:57:39.594672 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 93/209] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:39 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:39.595996 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8e24e0cc-f8ae-409f-96a4-b9afba2b8ce7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.222905 Oct 16 00:57:39.596811 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 117/210] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:39 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:40.621444 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:40.622136 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:40.622504 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:40.623198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:40.629756 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:40.630236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:40.630698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:40.630865 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:40.631498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:40.631616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:40.632056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:40.632183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:40.632585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:40.632880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:40.633354 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:40.633775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:40.846311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:40.850041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:40.854987 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-56b6b287-9d69-4871-b506-54a0bc2640c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.236465 Oct 16 00:57:40.855562 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 118/211] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:40 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:40.858304 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-48e2a7da-037f-4da3-81ab-f2cce0a0bee6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.244512 Oct 16 00:57:40.859078 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 94/212] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:40 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:41.877459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:41.878171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:41.882855 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:41.883455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:41.884170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:41.884649 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:41.885111 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:41.885863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:41.886213 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:41.886629 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:41.889930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:41.890500 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:41.891121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:41.891805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:41.892256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:41.892671 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:42.109661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:42.113722 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:42.122309 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8b969c4f-b2d1-4848-8244-b5fcf4b2b110 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.243176 Oct 16 00:57:42.123858 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9438d3d2-506c-4836-b101-dbeb3abec70b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.250244 Oct 16 00:57:42.124434 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 119/213] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:41 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:42.129211 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 95/214] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:41 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:43.146614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:43.147208 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:43.148320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:43.149199 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:43.153654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:43.154202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:43.154682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:43.155573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:43.156305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:43.156733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:43.157219 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:43.157880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:43.158467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:43.159253 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:43.160041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:43.160571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:43.358693 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:43.364373 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:43.366841 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-023bff97-f257-408f-9d85-ef498a720b50 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.225624 Oct 16 00:57:43.367447 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 120/215] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:43 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:43.374290 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8b0e5bb4-3494-4bdb-87d9-3e2fa451af38 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.230112 Oct 16 00:57:43.374915 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 96/216] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:43 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:44.388935 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:44.389578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:44.397663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:44.398749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:44.399275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:44.399787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:44.400212 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:44.400963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:44.401588 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:44.401698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:44.402142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:44.407078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:44.407732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:44.408335 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:44.409064 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:44.409672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:44.410103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:44.434757 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:44.472621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=10 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:44.612240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:44.613618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:44.616011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:44.621942 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-00b55395-129b-4b81-8279-4d63766846fd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.236737 Oct 16 00:57:44.622794 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 121/217] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:44 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:44.625806 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ba1d41a0-bcbd-4a92-9b68-6decfe966f6b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.231558 Oct 16 00:57:44.642906 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 97/218] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:44 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:44.647444 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511846b5-6613-4b20-8550-31b4067e1da2", "name": "network-vif-plugged", "status": "completed", "tag": "3e27aa79-19be-43f6-92b8-258048ba4a37"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:44.658159 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:44.658736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:44.659174 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:44.671588 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] Creating event network-vif-plugged:3e27aa79-19be-43f6-92b8-258048ba4a37 for instance 511846b5-6613-4b20-8550-31b4067e1da2 on hv-cinder-maste Oct 16 00:57:44.677011 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-b1ba0991-28d6-4fb0-a444-637072994b5b req-91a110b5-4c4e-4ff9-9ca1-930e7192775a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 Oct 16 00:57:44.677855 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 122/219] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:45.651747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:45.652530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:45.654183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:45.655627 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:45.661951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:45.666806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:45.667749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:45.667964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:45.668431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:45.668776 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:45.669710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:45.670034 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:45.670609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:45.671308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:45.671476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:45.672300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:45.673453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:45.873175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:45.880028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:45.881371 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8a9ef49a-9f88-4143-b7a4-79be47eb0fa5 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.234238 Oct 16 00:57:45.888829 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9904e49f-894d-4d21-ba4c-9f6f4922fab6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1522 microversion: 2.1 time: 0.243685 Oct 16 00:57:45.889487 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 98/220] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:45 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:45.896752 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 123/221] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:45 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:46.903852 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:46.904451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:46.910720 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:46.911196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:46.911418 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:46.911828 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:46.912176 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:46.912276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:46.912723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:46.913164 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:46.918928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:46.919421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:46.919866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:46.920572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:46.921089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:46.921517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:47.118595 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:47.126641 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0628bdc3-7be8-4c17-a017-b5390a5731aa tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1502 microversion: 2.1 time: 0.219008 Oct 16 00:57:47.133244 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 124/222] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:46 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:47.150343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:47.159404 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4dafd671-49d2-431b-acb8-52fe9b1e41f8 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1366 microversion: 2.1 time: 0.259463 Oct 16 00:57:47.159560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:47.160022 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:47.160407 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 99/223] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:46 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:47.165933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:47.166417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:47.166852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:47.167549 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:47.167999 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:47.168419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:47.298160 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:47.313496 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-cabc67bb-e5cb-4442-800b-c00e3ac60c56 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1516 microversion: 2.1 time: 0.157970 Oct 16 00:57:47.314128 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 125/224] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:47 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:48.182883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:48.183508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:48.189870 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.190342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.190785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.191507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.191951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.192376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.334589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:48.343024 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-48c4823f-28cf-4f31-91bc-b0328388c3aa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1556 microversion: 2.1 time: 0.164776 Oct 16 00:57:48.343672 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 100/225] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:48 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:48.366438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:48.366989 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:48.374270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.374747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.375198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.375888 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.376364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.376858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.458101 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ddfc3f65-8e0c-4706-a6d1-d90e40defa34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095482 Oct 16 00:57:48.458772 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 126/226] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 00:57:48 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:48.782584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:48.785338 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:48.792589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.793306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.793850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.795353 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.795813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.796237 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.828303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lazy-loading 'flavor' on Instance uuid f34fac95-f3ff-47f0-b784-01e96481a86b {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 00:57:48.958118 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f314c17e-fa75-4196-9a8d-7b6930b0addf tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/action" status: 200 len: 32 microversion: 2.1 time: 0.180602 Oct 16 00:57:48.958968 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 101/227] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 00:57:48 2022] POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 00:57:48.971633 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:48.972661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:48.983537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.985558 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.986101 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:48.987153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:48.987859 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:48.988584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:49.164050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:49.174701 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f435d986-5cf1-4b88-bffe-bdbb1c8c7716 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.207301 Oct 16 00:57:49.176071 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 127/228] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:48 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:50.200163 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:50.201549 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:50.219539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:50.220507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:50.222134 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:50.222613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:50.223629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:50.224146 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:50.305793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511846b5-6613-4b20-8550-31b4067e1da2", "tag": "3e27aa79-19be-43f6-92b8-258048ba4a37"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:57:50.322326 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:50.323268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:50.324005 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:50.341625 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] Creating event network-changed:3e27aa79-19be-43f6-92b8-258048ba4a37 for instance 511846b5-6613-4b20-8550-31b4067e1da2 on hv-cinder-maste Oct 16 00:57:50.348202 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-43a484f7-b74f-4d05-90ef-05d8ccc1c1b6 req-a32963e5-0462-4d01-936f-4fb684daa3ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048168 Oct 16 00:57:50.354540 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 128/229] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:57:50.418952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:50.427556 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-049aa61c-06dc-45bd-944d-bd08b65e60fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.232507 Oct 16 00:57:50.428766 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 102/230] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:50 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:51.451295 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:51.451980 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:51.459048 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:51.459544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:51.459982 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:51.460810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:51.461461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:51.462047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:51.609363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:51.618920 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a795b7ff-4fd4-4d4a-b7b0-3500f0b5e063 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.171805 Oct 16 00:57:51.620182 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 129/231] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:51 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:52.644641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:52.645437 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:52.654415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:52.655056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:52.655648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:52.656636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:52.657336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:52.658049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:52.797806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:52.809820 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-dd12469f-9d20-4ab5-9db8-894a4f0a9334 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.170115 Oct 16 00:57:52.810545 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 103/232] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:52 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:53.835992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:53.836553 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:53.842899 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:53.843416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:53.843844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:53.844507 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:53.844994 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:53.845416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:53.982868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:53.991053 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9cec4774-d9d6-465d-bc0d-3813dcd80b19 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.158990 Oct 16 00:57:53.991659 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 130/233] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:53 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:55.014112 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:55.014574 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:55.021567 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:55.022047 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:55.022481 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:55.023402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:55.023882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:55.024305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:55.157429 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:55.165746 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-29c479b3-d238-43e2-b5e0-36fc05d3e748 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.155899 Oct 16 00:57:55.166363 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 104/234] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:55 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:56.188984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:56.189592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:56.196107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:56.196584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:56.197045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:56.197731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:56.198183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:56.198598 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:56.330994 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:56.338806 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-71e11ec1-d571-4608-930c-d03b992c2977 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.153748 Oct 16 00:57:56.339378 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 131/235] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:56 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:57.368207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:57.380288 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:57.388548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:57.389150 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:57.389574 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:57.390276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:57.390728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:57.391173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:57.528606 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:57.538125 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3f04f1e8-9c21-441b-aba0-64311473a62b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.179157 Oct 16 00:57:57.538670 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 105/236] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:57 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:58.561532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:58.562147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:58.569063 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:58.569565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:58.570035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:58.570767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:58.571244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:58.571793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:58.588087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=100 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:58.709412 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:58.717330 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f9f2d74f-ac40-4a2a-b8d6-3756fea1da96 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.159606 Oct 16 00:57:58.717868 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 132/237] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:58 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:57:59.739950 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:57:59.740612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:57:59.747384 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:59.748085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:59.748680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:59.749592 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:57:59.750051 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:57:59.750459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:57:59.896654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:57:59.905740 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-42728114-962b-4634-b53a-6cc329153eab tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.169612 Oct 16 00:57:59.906442 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 106/238] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:57:59 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:00.933252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:00.934290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:00.942873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:00.943356 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:00.943787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:00.944471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:00.944949 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:00.945371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:01.089897 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:01.100131 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f7810086-d322-4c17-b949-10021e885156 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.173396 Oct 16 00:58:01.100780 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 133/239] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:00 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:02.123333 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:02.123938 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:02.130559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:02.131045 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:02.131480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:02.132165 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:02.132626 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:02.133055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:02.263594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:02.272483 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-632aff7c-fbca-4a6e-b90b-0332d69ca725 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.153034 Oct 16 00:58:02.273291 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 107/240] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:02 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:03.295574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:03.296180 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:03.302261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:03.302750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:03.303182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:03.303871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:03.304322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:03.304744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:03.439125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:03.447092 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-235a6db1-d2eb-4f77-a488-6c2a7b31f39a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.155522 Oct 16 00:58:03.447679 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 134/241] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:03 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:04.471404 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:04.471992 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:04.481075 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:04.481595 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:04.482080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:04.482880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:04.483397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:04.483890 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:04.761286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:04.770097 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d9fa840f-44d8-42fe-a45c-4cd69a89e48e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.302943 Oct 16 00:58:04.777277 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 108/242] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:04 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:05.794357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:05.794973 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:05.796983 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:05.802696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:05.803028 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:05.803472 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:05.804184 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:05.804646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:05.805103 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:05.940766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:05.948628 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-187e5c8d-245b-428b-8065-1193e4122621 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1502 microversion: 2.1 time: 0.158128 Oct 16 00:58:05.949224 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 135/243] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:05 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:05.970904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42c9b3cb-8a5d-4db8-ba83-6050b5511077"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:05.974079 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:05.981218 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:05.981698 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:05.982128 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:05.982814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:05.983261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:05.983673 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:06.006688 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] HTTP exception thrown: Cannot 'attach_volume' instance f34fac95-f3ff-47f0-b784-01e96481a86b while it is in vm_state rescued Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Request method failure captured: Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/os-volume_attachments HTTP/1.1 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 74 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1az5oSaOP7emFPSnqrD8Qd1eR4w_Tqq513Mv0EvXsbLF5G1I-f_hnNF51zFVaIHGgnlKweosha8QTEyQ9vAwZPh4oJm3x2t1QQkszzTTp61VvjSn_bc79PsTlJkS-JzTdnLQjZ-qqBov-bCdz21vap474ikSqvzL3pOfv9mfi2Aazc Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 00:58:06.009002 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_18cdea5418644c38bdff444de462b7c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/18cdea5418644c38bdff444de462b7c6"}]}] Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bb8be65b81ca4eee9a524ddb6577d188 Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: {"volumeAttachment": {"volumeId": "42c9b3cb-8a5d-4db8-ba83-6050b5511077"}} Oct 16 00:58:06.010459 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Cannot 'attach_volume' instance f34fac95-f3ff-47f0-b784-01e96481a86b while it is in vm_state rescued Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'server_id': 'f34fac95-f3ff-47f0-b784-01e96481a86b', 'body': {'volumeAttachment': {'volumeId': '42c9b3cb-8a5d-4db8-ba83-6050b5511077'}}} Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f34fac95-f3ff-47f0-b784-01e96481a86b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:58:06.011211 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f34fac95-f3ff-47f0-b784-01e96481a86b while it is in vm_state rescued Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:58:06.012470 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f34fac95-f3ff-47f0-b784-01e96481a86b while it is in vm_state rescued Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Returning 409 to user: Cannot 'attach_volume' instance f34fac95-f3ff-47f0-b784-01e96481a86b while it is in vm_state rescued {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f397740b-a2a9-4c45-b519-3165476e3e41 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043659 Oct 16 00:58:06.013752 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 109/244] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 00:58:05 2022] POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 00:58:06.020147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:06.020681 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:06.026977 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:06.027448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:06.027880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:06.028593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:06.029070 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:06.029493 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:06.099292 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3c16d1a5-127b-4755-bd0b-6ec2fe001cf7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/action" status: 202 len: 0 microversion: 2.1 time: 0.082976 Oct 16 00:58:06.100424 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 136/245] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 00:58:06 2022] POST /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 00:58:06.109898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:06.110619 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:06.117644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:06.118376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:06.118834 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:06.119705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:06.120269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:06.120736 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:06.259735 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:06.270636 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b1b663f0-6c81-41b5-bd48-7eeec613d123 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1510 microversion: 2.1 time: 0.164883 Oct 16 00:58:06.271576 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 110/246] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:06 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:07.300277 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:07.301087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:07.308446 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:07.309023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:07.309487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:07.310297 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:07.310796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:07.311266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:07.446839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:07.455011 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fa8f2bbc-44c8-4077-a81a-068474fc3c6e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1510 microversion: 2.1 time: 0.161956 Oct 16 00:58:07.455584 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 137/247] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:07 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:08.478369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:08.479007 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:08.486278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:08.486786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:08.487239 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:08.487977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:08.488452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:08.488895 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:08.628421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:08.636704 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-370a40a0-60cb-4d1f-9892-cb784cb1c1f5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1510 microversion: 2.1 time: 0.162885 Oct 16 00:58:08.637304 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 111/248] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:08 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:09.660478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:09.661180 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:09.667348 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:09.667830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:09.668266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:09.668990 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:09.669432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:09.669840 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:09.803705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:09.811558 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-62869963-cf0f-466e-a2a5-720c791e018a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1516 microversion: 2.1 time: 0.155097 Oct 16 00:58:09.812136 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 138/249] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:09 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:11.169294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cf3be8ae-6c29-48c9-8b91-e61f361a8526 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: .version_select at 0x7f58072415e0>, body: {"keypair": {"name": "tempest-keypair-978205372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNzbtz6m8VzswnC8yQ+D7mElEBmV606njeNd/fkvatWdeEnkpJzXfP1wR6WlN1DFj+wOXgBU3rZ929wGCIQzsE4sJjdOzCBGvSCmYTUjn2xszeET/sA/BjJnSZzed+16w=="}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:11.185849 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-cf3be8ae-6c29-48c9-8b91-e61f361a8526 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for project 18cdea5418644c38bdff444de462b7c6. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:58:11.189664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-cf3be8ae-6c29-48c9-8b91-e61f361a8526 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for user bb8be65b81ca4eee9a524ddb6577d188 and project 18cdea5418644c38bdff444de462b7c6. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:58:11.215002 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cf3be8ae-6c29-48c9-8b91-e61f361a8526 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049565 Oct 16 00:58:11.215600 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 112/250] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 00:58:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:12.548049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2112564212", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b52ba8d5-af32-4783-a739-c1ea3883d1e9"}], "security_groups": [{"name": "tempest-securitygroup--308762480"}], "key_name": "tempest-keypair-978205372", "user_data": "}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:12.652135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] validate_networks() for [('b52ba8d5-af32-4783-a739-c1ea3883d1e9', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:58:13.235400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:58:13.235825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:58:13.236286 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:58:13.236721 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:58:13.237156 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:58:13.246262 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:13.246738 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:13.247183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:13.247946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:13.248400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:13.248823 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:13.265520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:58:13.269611 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Getting quotas for user bb8be65b81ca4eee9a524ddb6577d188 and project 18cdea5418644c38bdff444de462b7c6. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:58:13.280618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:58:13.283070 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:58:13.334690 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e63f8d22-3fcc-4806-89da-c6fc57762f4a tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.790928 Oct 16 00:58:13.335331 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 139/251] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:58:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:58:13.346609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7dc05ca5-9610-4f37-a5ab-2f1dc61c4cec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:13.347343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7dc05ca5-9610-4f37-a5ab-2f1dc61c4cec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:13.402436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7dc05ca5-9610-4f37-a5ab-2f1dc61c4cec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:13.409340 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7dc05ca5-9610-4f37-a5ab-2f1dc61c4cec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1245 microversion: 2.1 time: 0.066710 Oct 16 00:58:13.409901 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 113/252] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:13 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:14.431719 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:14.432323 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:14.438928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:14.439416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:14.439816 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:14.440760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:14.441241 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:14.441663 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:14.509528 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:14.518675 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-23757c1d-a305-4ec6-8d99-2ada98e35325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1297 microversion: 2.1 time: 0.090858 Oct 16 00:58:14.519308 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 140/253] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:14 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:15.541694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:15.542231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:15.544683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:15.550181 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:15.550668 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:15.551088 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:15.551776 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:15.552224 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:15.552639 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:15.698488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:15.700683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:15.708446 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-000656d3-4795-479e-aec3-5a2466045325 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.170779 Oct 16 00:58:15.715888 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 114/254] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:15 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:16.177285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:16.186919 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:16.187493 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:16.187978 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:16.199667 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] Creating event network-changed:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 00:58:16.205428 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-91f82d80-597f-4a47-a40c-3de79f9eb237 req-8b314685-db91-4239-aef4-979b9f6f5ee9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031982 Oct 16 00:58:16.206235 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 141/255] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:16.731557 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:16.732138 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:16.740336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:16.740818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:16.741281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:16.742006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:16.742469 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:16.742884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:16.876529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:16.885015 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-27b8793e-7306-4eef-b6f6-aab4e3dfcd01 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.157361 Oct 16 00:58:16.885587 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 115/256] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:16 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:17.915638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:17.916884 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:17.926992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:17.927529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:17.927947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:17.928639 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:17.929139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:17.929568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:18.062873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:18.071326 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-35351ac0-4d9d-4799-aae3-a2031267c829 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.162751 Oct 16 00:58:18.071749 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 142/257] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:17 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:19.095454 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:19.096250 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:19.104438 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:19.104976 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:19.105421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:19.106113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:19.106536 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:19.106978 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:19.238277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:19.249489 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-bcba2ef1-2df6-43c9-b0d1-c71a6bbc4d1c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.158609 Oct 16 00:58:19.250255 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 116/258] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:19 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:20.277138 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:20.277737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:20.284114 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:20.284603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:20.285080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:20.285777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:20.286235 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:20.286666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:20.424677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:20.432488 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-aefbbba3-d2ff-4922-bb52-5c014cfb17b5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.159927 Oct 16 00:58:20.433074 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 143/259] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:20 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:21.455653 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:21.456200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:21.463552 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:21.464223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:21.464679 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:21.465402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:21.465858 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:21.466284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:21.598460 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:21.606921 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b6033b41-0be5-4181-9439-460b4f99c698 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.155269 Oct 16 00:58:21.607644 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 117/260] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:21 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:22.629027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:22.629657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:22.636776 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:22.637294 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:22.637866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:22.638724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:22.639369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:22.639883 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:22.741641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "name": "network-vif-plugged", "status": "completed", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:22.757022 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:22.757550 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:22.758160 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:22.769764 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] Creating event network-vif-plugged:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 00:58:22.775194 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-c0054a94-e53b-4040-b334-e38ebbe94cdf req-8803c31c-507d-42bf-a14e-83a133961b1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037472 Oct 16 00:58:22.775800 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 118/261] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:22.779749 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:22.787349 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7921eda0-1718-4b76-b5c6-7b002f06b743 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.162333 Oct 16 00:58:22.787914 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 144/262] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:22 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:23.807858 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:23.812739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:23.813477 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:23.820220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:23.820706 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:23.821182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:23.821875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:23.822358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:23.822814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:23.972987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:23.981824 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1d000e13-40c8-46ae-aa01-8a28db673dd6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1370 microversion: 2.1 time: 0.175053 Oct 16 00:58:23.982402 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 119/263] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:23 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:25.005961 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:25.006527 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:25.008579 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:25.009232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:25.015005 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:25.015491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:25.015925 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:25.016698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:25.017288 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:25.017750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:25.152415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:25.160574 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d06b989d-790d-449e-bbcc-d61fc735cdba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1565 microversion: 2.1 time: 0.159171 Oct 16 00:58:25.161153 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 145/264] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:58:25 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:25.182903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:25.183429 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:25.190276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:25.190732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:25.191164 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:25.191860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:25.192310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:25.192727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:25.273762 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7303c9b9-f83a-42e8-91fb-d6896c2bf9ec tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094851 Oct 16 00:58:25.274371 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 120/265] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 00:58:25 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:26.248009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:26.257930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:26.258400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:26.258822 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:26.270105 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] Creating event network-changed:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 00:58:26.275254 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-c6630875-163a-4660-9abb-d6c013ab6a35 req-82a72f35-4945-43ad-beec-b7afa82e9f45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Oct 16 00:58:26.276087 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 146/266] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:51.795475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=13 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:51.796654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=31 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:51.802999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:51.803801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:51.814653 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:51.815424 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:51.816143 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:51.817301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:51.818044 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:51.818743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:51.842494 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cbfcdf2b-f09b-4102-a576-285b033dda14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/ips" status: 200 len: 151 microversion: 2.20 time: 0.049542 Oct 16 00:58:51.843051 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 121/267] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 16 00:58:51 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:58:53.723811 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:53.725567 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:53.730293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:58:53.730912 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:53.738316 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:53.738783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:53.739214 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:53.739932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:53.740379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:53.740792 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:53.765169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lazy-loading 'flavor' on Instance uuid b12648b0-9359-4569-82b6-3e6fe3d53d6f {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 00:58:54.132624 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d039c82c-418f-46bf-b790-d4053672f68f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/action" status: 202 len: 0 microversion: 2.20 time: 0.410495 Oct 16 00:58:54.133291 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 147/268] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 16 00:58:53 2022] POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 00:58:54.143031 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:54.144048 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:54.150875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:54.151476 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:54.152006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:54.152746 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:54.153432 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:54.153889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:54.291696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:54.299934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:54.301411 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:54.302582 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-effe3163-80a0-4ea9-8557-5231a804efe8 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.164753 Oct 16 00:58:54.303124 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 122/269] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:58:54 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:58:55.333110 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:55.334324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:55.346417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:55.347107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:55.347821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:55.348979 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:55.349742 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:55.350878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:55.491127 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:55.499920 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:55.501472 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:55.502625 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f8ca23b0-ff09-4f46-99b2-df6c4ef843f3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.176670 Oct 16 00:58:55.503180 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 148/270] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:58:55 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:58:56.527975 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:56.528588 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:56.535580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:56.536064 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:56.536492 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:56.537216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:56.537675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:56.538103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:56.669322 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:56.677980 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:56.679413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:56.680560 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-224d5af3-2a9c-4a4d-bd8f-76e2994ed85f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.156592 Oct 16 00:58:56.681162 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 123/271] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:58:56 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:58:57.709043 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:57.709956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:57.718382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:57.718869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:57.719304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:57.719992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:57.720436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:57.720870 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:57.861466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:57.869804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:57.871257 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:57.872471 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-75af8737-28ec-4995-b2dd-ba411d9b5a04 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.169884 Oct 16 00:58:57.873047 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 149/272] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:58:57 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:58:58.618084 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:58.618701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:58.625609 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:58.626125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:58.626559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:58.627256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:58.627715 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:58.628140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:58.651451 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-02b0cb01-a57c-45c3-aded-c6b7bded639c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/ips" status: 200 len: 146 microversion: 2.1 time: 0.038114 Oct 16 00:58:58.652006 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 124/273] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 00:58:58 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:58.902060 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:58.902931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:58:58.913027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:58.913820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:58.914537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:58.915683 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:58.916435 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:58.917204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:59.049042 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:59.057078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:59.058511 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:58:59.059648 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-455a6664-ab45-4b40-b4cf-3ad0d18d18c4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.164357 Oct 16 00:58:59.060201 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 150/274] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:58:58 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:00.089955 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:00.091013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:00.098126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:00.098616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:00.099040 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:00.099741 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:00.100519 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:00.100974 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:00.232693 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:00.241395 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:00.242909 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:00.244055 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-525e7df7-3ef8-41f8-adc6-eb3d58345956 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.160955 Oct 16 00:59:00.244611 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 125/275] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:00 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:00.771452 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "146fcaac-bb7b-4fcd-8430-2550dcabc89f"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:00.773818 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:00.780242 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:00.780729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:00.781193 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:00.781891 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:00.782355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:00.782766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:01.118338 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9a201bf8-9175-4c12-b3ee-df5bd9dd3bf9 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350820 Oct 16 00:59:01.119387 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 151/276] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 00:59:00 2022] POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:01.270840 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:01.272056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:01.279005 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:01.279782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:01.280433 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:01.281486 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:01.282132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:01.282711 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:01.422743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:01.432557 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:01.434148 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:01.435816 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f54e9e87-eb56-40a8-9626-a571975b9f8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.169637 Oct 16 00:59:01.436488 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 126/277] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:01 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:02.468184 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:02.469005 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:02.476105 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:02.476589 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:02.477086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:02.477780 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:02.478223 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:02.478666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:02.616905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:02.628495 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:02.629989 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:02.631183 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7d39c381-55c2-41fa-bf25-b74e2925eea3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.171140 Oct 16 00:59:02.631731 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 152/278] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:02 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:03.390007 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:03.397052 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:03.397542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:03.397963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:03.457173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Going to try to stop instance {{(pid=118976) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 00:59:03.510988 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-06025e4c-b429-4028-b50f-4cb72bb139ed tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.126294 Oct 16 00:59:03.511506 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 127/279] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 00:59:03 2022] POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 00:59:03.520378 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:03.521027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:03.527525 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:03.528017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:03.528532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:03.529432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:03.529870 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:03.530327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:03.658399 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:03.659228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:03.666211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:03.666689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:03.667122 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:03.667322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:03.667818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:03.668270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:03.668693 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:03.675666 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-381e8853-7102-4ee6-aec8-6792b5b36ab6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.159196 Oct 16 00:59:03.676223 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 153/280] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:03 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:59:03.798800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:03.807376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:03.808809 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:03.809991 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d05d80b6-393a-4e45-b9e2-4f1a85402d36 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.156662 Oct 16 00:59:03.810603 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 128/281] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:03 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:04.702683 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:04.703213 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:04.710240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:04.710727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:04.711162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:04.711858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:04.712309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:04.712731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:04.836337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:04.836959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:04.843212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:04.843690 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:04.844120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:04.844804 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:04.845282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:04.845701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:04.859429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:04.867943 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-55e56b51-f4d9-4a61-af95-ea8bbaeba8ae tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.171315 Oct 16 00:59:04.868509 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 154/282] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:04 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:04.976041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:04.984318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:04.985779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:04.986929 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-79b69fb0-340b-4d35-be05-0b2ca676658c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.155356 Oct 16 00:59:04.987463 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 129/283] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:04 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:05.895821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:05.896655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:05.906589 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:05.907073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:05.907506 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:05.908198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:05.908651 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:05.909106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:06.021633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:06.022354 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:06.029216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:06.029740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:06.030222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:06.030887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:06.031339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:06.031738 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:06.042646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:06.051477 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e42d139e-c606-4734-ad4a-e96b476d0198 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.162539 Oct 16 00:59:06.052131 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 155/284] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:05 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:06.162378 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:06.174143 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:06.176039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:06.177750 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-25e74663-1a60-4ac4-8fae-d84aa6a32cbc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.159873 Oct 16 00:59:06.178502 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 130/285] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:06 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:07.074538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:07.075888 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:07.082679 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:07.083432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:07.083856 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:07.084733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:07.085621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:07.086313 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:07.206193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:07.207422 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:07.215049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:07.215537 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:07.215966 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:07.216660 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:07.217023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:07.217332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:07.218384 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:07.235880 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-37a0bab7-5a3f-44f2-bea4-64dd1f44c21c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.165049 Oct 16 00:59:07.236656 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 156/286] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:07 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:07.353281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:07.365205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:07.367474 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:07.369283 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-831089d1-4a7d-45d8-8652-ab7235e9e128 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.166721 Oct 16 00:59:07.369955 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 131/287] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:07 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:08.263592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:08.264529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:08.275319 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:08.276114 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:08.276830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:08.278015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:08.278766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:08.279575 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:08.395873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:08.396504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:08.403337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:08.403837 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:08.404326 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:08.405051 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:08.405483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:08.405922 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:08.419808 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:08.428075 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-915acf9d-524e-4ad1-9dee-bd6f8284ee7a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.171091 Oct 16 00:59:08.428955 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 157/288] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:08 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:08.539778 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:08.548446 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:08.549921 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:08.551074 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d6bcfb8c-256f-4b9d-8af5-7c5639c424d9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.159209 Oct 16 00:59:08.551634 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 132/289] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:08 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:08.933480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "name": "network-vif-plugged", "status": "completed", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:08.945472 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:08.945956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:08.946388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:08.958215 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] Creating event network-vif-plugged:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:59:08.963258 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-27cc8e27-af2c-4e59-89fc-3c23d4b8bb69 req-e5207529-933b-4bc8-959c-a75bce376f46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034006 Oct 16 00:59:08.963934 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 158/290] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:09.455442 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:09.456255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:09.467054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:09.467869 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:09.468603 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:09.469873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:09.470684 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:09.471390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:09.576734 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:09.577573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:09.584498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:09.585022 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:09.585441 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:09.586133 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:09.586580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:09.586997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:09.617098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:09.625894 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c8c059e9-b1f1-4026-a00e-8b5c6a17048f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.177220 Oct 16 00:59:09.626484 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 133/291] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:09 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:09.718998 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:09.727666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:09.729160 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:09.730315 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8c489af7-87de-478a-9c6d-4686d240a91f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.157936 Oct 16 00:59:09.730882 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 159/292] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:09 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:10.653241 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:10.654244 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:10.662651 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:10.663289 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:10.663836 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:10.664679 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:10.665290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:10.665818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:10.755785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:10.756358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:10.763667 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:10.764195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:10.764620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:10.765312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:10.765768 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:10.766188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:10.820376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:10.829306 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7b9c5ba1-7eeb-46e5-b8bb-e5ed6883de5f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.182774 Oct 16 00:59:10.830231 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 134/293] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:10 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:10.906430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:10.910002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:10.915335 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:10.916778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:10.917984 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-331faad8-d9e8-4a38-ad1e-4ee5469a3cfb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.166113 Oct 16 00:59:10.918516 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 160/294] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:10 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:59:11.857087 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:11.857749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:11.864868 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:11.865418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:11.865880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:11.866612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:11.867096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:11.867547 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:11.944584 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:11.945312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:11.953044 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:11.953694 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:11.954415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:11.955554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:11.956304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:11.957043 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:12.032390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:12.041084 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3fdcf763-d6ed-48c7-a51d-06b877fb1712 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.188269 Oct 16 00:59:12.041753 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 135/295] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:11 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:12.096853 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:12.105742 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:12.107270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:12.108368 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1f7eba39-14a3-47fe-9df4-aeaf7eb43934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.168273 Oct 16 00:59:12.108962 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 161/296] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:11 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:59:13.068601 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:13.069841 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:13.079175 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:13.079659 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:13.080091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:13.080819 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:13.081300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:13.081716 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:13.133873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:13.134480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:13.142037 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:13.143186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:13.143625 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:13.144330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:13.144823 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:13.145264 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:13.251082 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:13.259726 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d961399a-c550-4a3e-b468-4fb453e9c099 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1724 microversion: 2.1 time: 0.197739 Oct 16 00:59:13.260363 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 136/297] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:13 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:13.297462 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:13.306181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:13.307611 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:13.308767 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4665527a-ac3b-44e9-9d36-268f8516affb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1743 microversion: 2.20 time: 0.178906 Oct 16 00:59:13.309348 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 162/298] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:13 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:14.283649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:14.284568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:14.295481 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.296402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.296871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.297566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.298197 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.298817 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.303242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:14.337194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:14.340314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:14.351554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.352331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.353085 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.353984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.354577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.355147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.681838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:14.696679 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6604f422-2041-401f-9b30-381a52647770 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1701 microversion: 2.1 time: 0.417036 Oct 16 00:59:14.708900 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 137/299] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:14 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1701 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:14.724033 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:14.728956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:14.730880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.731418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.732115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.739485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:14.741155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:14.742610 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3b316358-2c29-435c-83db-23461c64f3cb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.412118 Oct 16 00:59:14.756897 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 163/300] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:14 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:14.757107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Going to try to start instance {{(pid=118976) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 00:59:14.804368 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d1c82430-57fe-4d80-8ad3-942c5290e63e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.084053 Oct 16 00:59:14.805300 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 138/301] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 00:59:14 2022] POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 00:59:14.813355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:14.814287 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:14.820871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.821496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.822197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.823108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:14.823941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:14.824462 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:14.988764 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:14.998149 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a264a169-0c5c-401c-8002-eb68cabf0cb2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1710 microversion: 2.1 time: 0.188523 Oct 16 00:59:15.004258 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 164/302] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:14 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:15.770598 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:15.771394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:15.778431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:15.778950 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:15.779489 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:15.780261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:15.780738 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:15.781560 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:15.929374 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:15.938045 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:15.939508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:15.940870 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-874e6c68-3ea0-4568-8cf5-526f0d32ca2e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.175264 Oct 16 00:59:15.941675 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 139/303] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:15 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:16.026332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:16.027146 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:16.038629 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:16.039172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:16.039976 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:16.040879 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:16.041593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:16.042274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:16.197426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:16.208202 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-391a77ef-6b2d-4020-8eec-9015beddf361 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1710 microversion: 2.1 time: 0.185828 Oct 16 00:59:16.225170 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 165/304] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:16 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:16.969172 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:16.970991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:16.979728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:16.980706 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:16.983268 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:16.984346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:16.985078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:16.985733 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:17.193764 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:17.202494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:17.203924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:17.205122 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a1066e43-fd5c-46fa-87cd-983e3a71d4bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.240657 Oct 16 00:59:17.205661 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 140/305] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:16 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:17.234546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:17.235109 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:17.241663 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:17.242152 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:17.242661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:17.243374 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:17.243807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:17.244225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:17.386150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:17.395029 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5008e920-109b-450a-b958-bc35481563c4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1714 microversion: 2.1 time: 0.164462 Oct 16 00:59:17.395903 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 166/306] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:17 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:18.231332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:18.231976 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:18.241627 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:18.242106 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:18.242532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:18.243215 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:18.243678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:18.244084 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:18.383771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:18.393699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:18.395200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:18.396404 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a9dfd448-e5bb-4664-b974-a984d43222f9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.169024 Oct 16 00:59:18.397166 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 141/307] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:18 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:19.421884 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:19.422531 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:19.429239 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:19.429714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:19.430152 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:19.430831 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:19.431338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:19.431771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:19.575592 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:19.583837 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:19.585295 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:19.586467 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7259fd73-ab9c-420c-91c7-8b23d79f39cc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.168687 Oct 16 00:59:19.587036 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 167/308] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:19 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:20.433914 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:20.434569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:20.441283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:20.441773 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:20.442215 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:20.442908 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:20.443364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:20.443771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:20.467283 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fbdc5933-6cbf-42db-bd04-22c7f444fa92 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/ips" status: 200 len: 150 microversion: 2.1 time: 0.037235 Oct 16 00:59:20.467854 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 142/309] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 00:59:20 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:20.615264 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:20.616936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:20.625305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:20.626182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:20.627077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:20.628138 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:20.628817 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:20.629482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:20.797248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:20.808172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:20.810249 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:20.815672 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5e55dc21-65a9-4cd7-9c09-655d406119ab tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.203484 Oct 16 00:59:20.816241 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 168/310] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:20 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:21.845015 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:21.845640 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:21.850649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=45 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:21.854930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:21.860930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:21.861602 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:21.862501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:21.863107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:21.863685 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:21.960386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a0b48dc-29ac-47d3-a3d9-893498ea1fa2"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:21.964116 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:21.971432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:21.972166 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:21.972760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:21.973955 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:21.974720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:21.975545 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:22.033500 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:22.044486 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:22.046849 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:22.048518 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-982a4621-0e47-43c1-b7f0-1f267114fd1a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.207624 Oct 16 00:59:22.049533 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 143/311] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:21 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:22.295663 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b4e58074-013f-4d42-a2ab-924472f9d1ec tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339223 Oct 16 00:59:22.296467 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 169/312] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 00:59:21 2022] POST /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:23.091897 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:23.092672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:23.100787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:23.101286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:23.101971 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:23.102819 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:23.103606 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:23.104172 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:23.263957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:23.272511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:23.274233 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:23.275427 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b93bf86a-0fb9-4e10-8cab-657352a80116 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.200720 Oct 16 00:59:23.276197 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 144/313] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:23 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:24.306456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:24.307590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:24.310712 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=47 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:24.318982 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:24.319826 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:24.320547 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:24.321702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:24.322457 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:24.323192 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:24.459205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:24.467700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:24.469148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:24.470553 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-352fb3d3-7d57-4690-8a71-58aefb4bb45b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1738 microversion: 2.20 time: 0.171969 Oct 16 00:59:24.471042 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 170/314] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:24 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:24.582196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3df62421-382f-433f-ae00-de48b0261eb7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: .version_select at 0x7f58070aeee0>, body: {"keypair": {"name": "tempest-keypair-1813694886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPDvhSNmAGB39a91XecSYFjpHe5qZq3GdkD9KA82dGbRISkFmbqF2itmEnTnDbH2JOxEFv0FDrdgeR56fTnK4QUTIwu5SF51R2Ymd5/uGW+Rz/ikPJh0bHmvdCSMKhhbQ=="}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:24.599245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-3df62421-382f-433f-ae00-de48b0261eb7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:59:24.603658 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-3df62421-382f-433f-ae00-de48b0261eb7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:59:24.628647 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3df62421-382f-433f-ae00-de48b0261eb7 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050349 Oct 16 00:59:24.629270 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 145/315] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 00:59:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:25.497843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:25.498547 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:25.506644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:25.507144 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:25.507706 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:25.508617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:25.509418 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:25.510144 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:25.699924 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:25.709114 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:25.710615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:25.711781 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a636c61d-b0fa-483d-8611-07a894fc922a tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1720 microversion: 2.20 time: 0.219843 Oct 16 00:59:25.712367 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 171/316] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:25 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:25.999095 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1369741167", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3913489d-de8f-457c-b3d2-8d2ca6fdbe30"}], "security_groups": [{"name": "tempest-securitygroup--41742749"}], "key_name": "tempest-keypair-1813694886", "user_data": "}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:26.108421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] validate_networks() for [('3913489d-de8f-457c-b3d2-8d2ca6fdbe30', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 00:59:26.483842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 00:59:26.484270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 00:59:26.484727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 00:59:26.485154 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 00:59:26.485572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 00:59:26.495010 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.495501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.495910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.496696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.497401 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.497556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.515841 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 00:59:26.520057 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 00:59:26.531750 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 00:59:26.534101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 00:59:26.581203 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [4b762d08-2a2b-4c7c-a29d-bbc75e845c07] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 00:59:26.742573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:26.743490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:26.754383 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.755188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.755906 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.757152 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.757904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.758610 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.899304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:26.907602 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:26.909086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:26.910251 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-67a84029-394a-41c5-84b9-9d5a264e2dfe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1720 microversion: 2.20 time: 0.174453 Oct 16 00:59:26.910816 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 172/317] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:26 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:26.941353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:26.951390 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.951802 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.952308 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.964949 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] Creating event network-vif-unplugged:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:59:26.970170 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-2e7f5f3c-9834-4a35-b681-0e28ea9e80de req-12b38c59-bae7-49d0-b45c-bff0642e6c1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033030 Oct 16 00:59:26.970795 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 173/318] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:27.588724 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [4b762d08-2a2b-4c7c-a29d-bbc75e845c07] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50108. Oct 16 00:59:27.593737 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a0bd7f28-9cbd-4f87-aca2-d7ea8ab9e779 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.599416 Oct 16 00:59:27.599217 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 146/319] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 00:59:25 2022] POST /compute/v2.1/servers => generated 400 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 00:59:27.606875 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f4ac775a-64c3-4c8e-a37c-cced40733edb tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:27.607530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f4ac775a-64c3-4c8e-a37c-cced40733edb tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:27.666505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f4ac775a-64c3-4c8e-a37c-cced40733edb tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:27.674096 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f4ac775a-64c3-4c8e-a37c-cced40733edb tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1242 microversion: 2.1 time: 0.071599 Oct 16 00:59:27.674872 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 174/320] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:27 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:27.935470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:27.936078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:27.943029 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:27.943539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:27.943973 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:27.944645 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:27.945146 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:27.945563 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.079464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.088566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.090350 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.092302 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d11d6e55-7a28-4f7f-a988-cc6729ae4b8c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1723 microversion: 2.20 time: 0.161126 Oct 16 00:59:28.105052 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 147/321] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:27 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:28.120211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295e4b2b-8e36-41a8-89d0-cf52c0d9cffe"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:28.122842 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:28.130361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.130865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.131303 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.132171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.132637 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.133093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.408939 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:28.428692 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-27cc9c13-a2bd-4046-a86f-3f5728324bf4 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313385 Oct 16 00:59:28.429353 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 175/322] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 16 00:59:28 2022] POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:59:28.566536 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:28.567420 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:28.575724 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.576248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.576728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.577502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.577963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.579028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.625173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118976) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 00:59:28.697706 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b216488d-5e25-417f-8a41-4e6798f785e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/action" status: 202 len: 0 microversion: 2.20 time: 0.135415 Oct 16 00:59:28.698050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:28.701528 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 148/323] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 16 00:59:28 2022] POST /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 00:59:28.702274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:28.706677 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:28.707513 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:28.710402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.711170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.712435 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.713339 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.713943 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.714529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.716816 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.717515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.718091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.718830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:28.719371 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:28.720012 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:28.794938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.804703 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b9d5bbcc-68ca-4cbf-95db-1c3244952314 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1294 microversion: 2.1 time: 0.111336 Oct 16 00:59:28.805315 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 176/324] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:28 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:59:28.884626 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.894124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.896289 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:28.897424 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0b113317-4f99-4af1-9fb2-f44ecaa2cad2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1749 microversion: 2.20 time: 0.194816 Oct 16 00:59:28.897991 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 149/325] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:28 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:29.828127 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:29.829069 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:29.838061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:29.838576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:29.839011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:29.839699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:29.840145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:29.840552 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:29.909085 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:29.917883 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-65063453-ce12-43f3-b6f2-41fa0d8e48b2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1300 microversion: 2.1 time: 0.092847 Oct 16 00:59:29.918318 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 177/326] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:29 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:29.923690 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:29.924302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:29.930715 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:29.931192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:29.931617 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:29.932303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:29.932811 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:29.933426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:30.083915 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:30.094436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:30.096218 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:30.097572 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c8a5c83e-8cdb-4706-802d-1df22c61f3ef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1751 microversion: 2.20 time: 0.178014 Oct 16 00:59:30.098303 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 150/327] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:29 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:30.837491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4434ad0-46fe-4731-affd-44c026f7f955", "tag": "c6ac8b52-0df2-4f03-9e5b-3268cab7db97"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:30.849054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:30.849577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:30.850479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:30.863758 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] Creating event network-changed:c6ac8b52-0df2-4f03-9e5b-3268cab7db97 for instance b4434ad0-46fe-4731-affd-44c026f7f955 on hv-cinder-maste Oct 16 00:59:30.869782 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-a15f1336-e88a-41ad-b39f-1f0f3939b87e req-e7e7e934-d802-4951-8de8-3c18bdac7499 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Oct 16 00:59:30.870602 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 178/328] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:30.939803 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:30.940436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:30.947571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:30.948051 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:30.948450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:30.949233 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:30.949680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:30.950096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:31.093113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:31.101419 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-38d3e021-1105-4c95-b375-f8fb7922ae44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.165676 Oct 16 00:59:31.101984 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 151/329] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:30 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:31.124281 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:31.125008 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:31.131925 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:31.132574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:31.133102 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:31.134187 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:31.134643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:31.135059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:31.273392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:31.282428 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:31.283906 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:31.285173 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-20f94c73-6edc-4db8-ba06-a240f23261bc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.165261 Oct 16 00:59:31.285672 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 179/330] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:31 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:32.123969 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:32.124565 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:32.131418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:32.132206 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:32.132785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:32.133597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:32.134050 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:32.134466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:32.277480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:32.285768 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1ff5cf43-04dc-4cf8-93ab-1c0bd48be9f9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.165738 Oct 16 00:59:32.286362 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 152/331] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:32 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:32.310870 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:32.311873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:32.320233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:32.321059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:32.321634 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:32.322436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:32.322954 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:32.323503 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:32.465908 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:32.475739 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:32.477201 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:32.478371 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ad55b838-7389-4535-a948-bcc59b75de29 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.171649 Oct 16 00:59:32.479024 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 180/332] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:32 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:33.311080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:33.312002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:33.320273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:33.320889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:33.321439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:33.322340 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:33.322893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:33.323413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:33.467678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:33.471174 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:33.477304 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7c276a4a-0afd-42cc-a043-e70abac2bc78 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.171070 Oct 16 00:59:33.477874 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 153/333] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:33 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:33.505022 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:33.506188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:33.513137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:33.513807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:33.514242 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:33.514930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:33.515377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:33.515796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:33.647710 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:33.656944 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:33.658398 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:33.659555 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2667d451-d133-41e7-9733-180ca43f0a22 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.158524 Oct 16 00:59:33.660104 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 181/334] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:33 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:34.506116 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:34.507157 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:34.519011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:34.519822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:34.520543 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:34.521739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:34.522485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:34.523197 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:34.662538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:34.672714 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c1f42e52-7073-444c-bf92-81cfcf23e770 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.173361 Oct 16 00:59:34.673311 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 154/335] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:34 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:34.684923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:34.685698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:34.694800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:34.695470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:34.696032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:34.696987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:34.697632 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:34.698165 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:34.830601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:34.842800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:34.844733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:34.846457 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f6c5f1c3-c142-4472-8747-f38abf5e5524 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.165266 Oct 16 00:59:34.847257 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 182/336] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:34 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:35.695618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:35.696325 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:35.703234 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:35.703718 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:35.704329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:35.705285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:35.705922 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:35.706525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:35.850119 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:35.858220 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b93d26d1-2080-4456-ad65-198e3536e64f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.166643 Oct 16 00:59:35.861043 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 155/337] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:35 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:35.872121 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:35.872910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:35.879567 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:35.880050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:35.880504 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:35.881225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:35.881671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:35.882075 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:36.012946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:36.021908 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:36.023363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:36.024589 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0d14bd71-068c-4b68-8191-5290a6e4e786 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.156633 Oct 16 00:59:36.025246 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 183/338] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:35 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:36.882308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:36.882904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:36.884804 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:36.886179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=10 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:36.892336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:36.892813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:36.893293 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:36.893992 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:36.894444 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:36.894864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:37.053454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:37.054189 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:37.061132 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:37.062334 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:37.062573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:37.063171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:37.064064 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:37.064677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:37.065319 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:37.104227 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fc435413-f449-4638-a0c4-a69cadd3918e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.225852 Oct 16 00:59:37.122318 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 156/339] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:36 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:37.131159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4434ad0-46fe-4731-affd-44c026f7f955", "name": "network-vif-plugged", "status": "completed", "tag": "c6ac8b52-0df2-4f03-9e5b-3268cab7db97"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:37.142568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:37.143178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:37.143700 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:37.175081 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] Creating event network-vif-plugged:c6ac8b52-0df2-4f03-9e5b-3268cab7db97 for instance b4434ad0-46fe-4731-affd-44c026f7f955 on hv-cinder-maste Oct 16 00:59:37.182502 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-7fb197f4-79a8-4002-b84b-49ed29b16d56 req-8248e4df-7917-4a26-b019-98c41d2aa6d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055667 Oct 16 00:59:37.188940 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 157/340] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 00:59:37.283002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:37.293374 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:37.294897 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:37.296142 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-82a0ee6b-3661-4bf9-8832-8d42b2221243 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.249176 Oct 16 00:59:37.296735 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 184/341] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:37 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:38.140424 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:38.142179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:38.149774 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:38.150339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:38.150896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:38.151671 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:38.152243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:38.152680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:38.288546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:38.297446 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f1353a43-483b-4b5d-bb34-6b3ae4d7dcf0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.161710 Oct 16 00:59:38.298355 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 158/342] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:38 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:38.322336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:38.322934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:38.324926 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:38.331459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:38.331964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:38.332427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:38.333146 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:38.333593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:38.334013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:38.471717 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:38.482248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:38.483945 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:38.485551 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-54bd2722-b23e-4e8f-98ee-fb03b2f5396b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.167032 Oct 16 00:59:38.495099 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 185/343] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:38 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:39.324332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:39.325406 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:39.332708 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:39.333268 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:39.333688 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:39.334394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:39.334862 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:39.335279 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:39.479589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:39.487482 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9cf3ee06-2735-46cf-83e5-f3498d8af727 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.169660 Oct 16 00:59:39.488042 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 159/344] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:39 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:39.511291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:39.511922 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:39.519834 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:39.520445 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:39.520995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:39.521735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:39.522304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:39.522789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:39.667246 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:39.675771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:39.677227 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:39.678379 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-be9b9a6f-7fdd-43d0-a54d-81d22d97e7fc tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.171149 Oct 16 00:59:39.678943 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 186/345] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:39 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:40.509705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:40.510411 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:40.516993 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:40.517556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:40.517998 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:40.518737 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:40.519183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:40.519598 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:40.655605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:40.663677 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8440f660-bda0-4df0-b3a3-19d95e623b6c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.157873 Oct 16 00:59:40.664266 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 160/346] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:40 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:40.704608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:40.705270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:40.711806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:40.712291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:40.712724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:40.713462 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:40.714016 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:40.714442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:40.851645 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:40.860355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:40.861830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:40.863007 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ce088053-cf48-4ee1-9f27-22cb683dc0d3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.162549 Oct 16 00:59:40.863569 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 187/347] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:40 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:41.687864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:41.688521 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:41.695395 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:41.695886 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:41.696314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:41.697064 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:41.697524 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:41.698121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:41.841244 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:41.848953 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-94216c77-6d9b-42be-9928-217649efc628 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.165047 Oct 16 00:59:41.849825 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 161/348] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:41 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:59:41.891002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:41.892792 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:41.899974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:41.900455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:41.900985 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:41.901684 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:41.902162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:41.902617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:42.044377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:42.053267 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:42.054723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:42.055882 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e117ef43-853b-4801-a4ec-0744658cff2b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.169760 Oct 16 00:59:42.056454 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 188/349] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:41 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:59:42.875612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:42.876324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:42.882967 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:42.883445 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:42.883875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:42.884569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:42.885059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:42.885481 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:43.018291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:43.029194 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f1d9b0d9-c06a-41c1-adff-ed76a815c782 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.159282 Oct 16 00:59:43.030532 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 162/350] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:42 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:43.081815 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:43.083263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:43.090449 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:43.091280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:43.092548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:43.093434 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:43.093970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:43.094461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:43.229608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:43.238526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:43.239956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:43.241210 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-03a5dd69-8b7d-4632-9c61-853901228e21 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.163278 Oct 16 00:59:43.241786 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 189/351] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:43 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:59:44.051879 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:44.052498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:44.059153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:44.059638 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:44.060071 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:44.060758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:44.061254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:44.061667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:44.208091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:44.215883 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-87a9a73f-d3b3-4243-b6ba-196d6a5b4b2d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.167998 Oct 16 00:59:44.216481 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 163/352] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:44 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:44.268803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:44.269680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:44.276686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:44.277139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:44.277573 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:44.278268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:44.278718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:44.279140 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:44.420320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:44.429518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:44.430928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:44.432124 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5a02c178-26e8-4076-8b05-53b63773bded tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.168265 Oct 16 00:59:44.432693 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 190/353] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:44 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:45.239380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:45.240012 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:45.246736 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:45.247227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:45.247654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:45.248342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:45.248792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:45.249246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:45.388921 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:45.396760 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5e3a9594-5283-4bf6-96f1-db64417c9593 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.161484 Oct 16 00:59:45.397344 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 164/354] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:45 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:45.457619 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:45.458240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:45.464543 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:45.465056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:45.465480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:45.466157 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:45.466600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:45.467013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:45.602389 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:45.610986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:45.612408 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:45.613586 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ef533819-01f3-4c5e-8c38-9c968d6b83b1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.159973 Oct 16 00:59:45.614177 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 191/355] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:45 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:46.419756 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:46.420466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:46.427294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:46.427794 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:46.428243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:46.428932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:46.429380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:46.429826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:46.559581 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:46.567807 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-891082d4-d8ec-4c1e-b9dd-65d522dc00e4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.152044 Oct 16 00:59:46.568368 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 165/356] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:46 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:46.643131 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:46.644163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:46.655255 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:46.656060 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:46.656781 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:46.657969 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:46.658729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:46.659453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:46.682256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:46.799425 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:46.808703 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:46.810178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:46.811340 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a4aa9263-ab7e-4d3b-ad2a-62ae4a3e0213 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.174906 Oct 16 00:59:46.811901 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 192/357] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:46 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:47.595042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:47.596090 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:47.607494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:47.608286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:47.609101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:47.610056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:47.610515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:47.610934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:47.754028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:47.765757 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6e63b893-5713-48ea-aa86-77ed936c45b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.177004 Oct 16 00:59:47.766547 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 166/358] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:47 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:47.841614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:47.842633 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:47.850060 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:47.850474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:47.850903 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:47.851586 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:47.852035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:47.852451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:47.984009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:47.993149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:47.994561 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:47.995705 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ffd0a458-4d7a-45a6-ab47-558e751e180b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.161355 Oct 16 00:59:47.996261 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 193/359] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:47 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:48.792070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:48.793177 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:48.803989 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:48.804799 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:48.805573 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:48.806724 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:48.807491 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:48.808201 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:48.944647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:48.952587 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8644801d-d9cc-465e-99b8-ccef56c862ba tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.167074 Oct 16 00:59:48.953239 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 167/360] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:48 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:49.024554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:49.025563 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:49.035922 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:49.036666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:49.037393 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:49.038447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:49.039148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:49.039807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:49.180743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:49.189709 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:49.191171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:49.192332 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-acb529e7-3841-4988-8dd4-ba47039ca50d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.173836 Oct 16 00:59:49.192870 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 194/361] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:49 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:49.980692 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:49.981788 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:49.989464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:49.989949 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:49.990385 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:49.991085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:49.991536 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:49.991959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:50.127617 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:50.135929 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3eafa1d7-930e-422d-900b-5e16b2cd169e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.162783 Oct 16 00:59:50.136506 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 168/362] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:49 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:50.221088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:50.222011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:50.233206 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:50.233996 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:50.234711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:50.235839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:50.236583 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:50.237514 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:50.373858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:50.387341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:50.389465 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:50.391033 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-99b7b89b-56a3-49ce-8c70-fbcb44a5e8a1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.176572 Oct 16 00:59:50.391626 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 195/363] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:50 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:51.160354 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:51.161017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:51.167881 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:51.168368 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:51.168801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:51.169522 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:51.169974 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:51.170400 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:51.301456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:51.309488 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f1cb1789-134e-499e-a303-2682ed5a5d6e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.153140 Oct 16 00:59:51.310056 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 169/364] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:51 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:51.420775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:51.421725 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:51.429794 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:51.430355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:51.430859 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:51.431668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:51.432201 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:51.432692 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:51.571560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:51.584453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:51.586648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:51.588322 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-41775a88-4189-4649-8d45-9a59ac7d62f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.173911 Oct 16 00:59:51.589117 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 196/365] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:51 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:52.336630 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:52.337525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:52.341426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:52.348115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:52.348618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:52.349095 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:52.350209 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:52.350667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:52.351091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:52.482304 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:52.493730 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7241009d-8c3a-4de5-bfcf-2f7b82b3b110 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.163581 Oct 16 00:59:52.494527 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 170/366] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:52 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:52.619882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:52.620738 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:52.631643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:52.632420 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:52.633220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:52.634345 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:52.635102 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:52.635803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:52.981667 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:52.990769 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:52.992203 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:52.993399 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-abac23c8-d932-4647-8fd2-73781d8bbf14 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.380219 Oct 16 00:59:52.993956 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 197/367] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:52 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:53.518805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:53.519459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:53.526976 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:53.527531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:53.528016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:53.528763 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:53.529303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:53.529775 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:53.534054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=100 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:53.662571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:53.670918 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-296ec8d3-ea2c-44bd-9f53-d542932420bd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.157385 Oct 16 00:59:53.671491 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 171/368] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:53 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:54.025475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:54.026509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:54.035361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:54.035847 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:54.036275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:54.037011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:54.037468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:54.037901 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:54.172326 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:54.181360 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:54.182809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:54.183979 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0a2fb1f1-730b-42eb-b116-40fcfe794589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.165246 Oct 16 00:59:54.184547 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 198/369] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:54 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:54.698125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:54.698964 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:54.709932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:54.710734 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:54.711453 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:54.712596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:54.713402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:54.714118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:54.852590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:54.860637 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1ed9b019-50d7-47f6-90c8-d48e40046a96 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1366 microversion: 2.1 time: 0.169147 Oct 16 00:59:54.861237 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 172/370] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:54 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:55.209900 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:55.210462 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:55.212821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=60 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:55.218409 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:55.218898 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:55.219350 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:55.220042 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:55.220490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:55.220940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:55.261187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "name": "network-vif-plugged", "status": "completed", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:55.271216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:55.271702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:55.272131 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:55.283743 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] Creating event network-vif-plugged:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 00:59:55.289259 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-fc7e8e32-66c5-47c0-b3c7-aa145a66d402 req-d5703f4c-b179-4f18-a26a-2d67babde28c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Oct 16 00:59:55.290168 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 173/371] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:55.357530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:55.366562 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:55.368155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:55.369374 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-58aa4536-f450-489b-a7b1-dee1ba8205fe tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.163497 Oct 16 00:59:55.369927 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 199/372] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:55 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:55.885941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:55.886624 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:55.893221 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:55.893710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:55.894144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:55.894825 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:55.895279 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:55.895702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:56.027910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:56.036371 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d216224e-d4ee-4992-b9e9-fe18c0911696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1556 microversion: 2.1 time: 0.155662 Oct 16 00:59:56.036997 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 174/373] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 00:59:55 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:59:56.058774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:56.059240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:56.065549 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:56.066033 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:56.066619 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:56.067320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:56.067791 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:56.068240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:56.145491 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5b87654b-ca1c-44dc-a6aa-63940b9d4f5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090823 Oct 16 00:59:56.146186 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 200/374] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 00:59:56 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:56.395393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:56.395911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:56.402192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:56.402675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:56.403107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:56.403798 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:56.404245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:56.404687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:56.640610 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:56.650092 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:56.651459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:56.652598 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1edcc7dc-8f8d-4ff9-abbe-1babf2ac781e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.261492 Oct 16 00:59:56.653212 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 175/375] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:56 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:57.151964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4434ad0-46fe-4731-affd-44c026f7f955", "tag": "c6ac8b52-0df2-4f03-9e5b-3268cab7db97"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:59:57.161701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:57.162182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:57.162607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:57.174054 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] Creating event network-changed:c6ac8b52-0df2-4f03-9e5b-3268cab7db97 for instance b4434ad0-46fe-4731-affd-44c026f7f955 on hv-cinder-maste Oct 16 00:59:57.179116 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-7802c009-6daf-4629-a8f3-9e4e86e406c0 req-cd08f280-07a0-48a2-8377-52440189c7a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031535 Oct 16 00:59:57.179909 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 201/376] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 00:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:59:57.678393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:57.678986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:57.686016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:57.686504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:57.686941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:57.687601 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:57.688270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:57.688701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:57.828455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:57.837590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:57.839044 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:57.840225 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ef2065c9-6008-4a4d-bbb6-a22e6576544c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1807 microversion: 2.20 time: 0.165896 Oct 16 00:59:57.840781 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 176/377] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:57 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:58.866324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:59:58.867026 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 00:59:58.874250 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:58.874748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:58.879750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:58.880625 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:58.881123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:58.881562 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:59.016218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:59.025327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:59.026774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 00:59:59.027938 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c13ba62a-027d-478b-89c3-7a47a6405ac6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1794 microversion: 2.20 time: 0.166273 Oct 16 00:59:59.028458 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 202/378] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 00:59:58 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:08.779829 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954a92c4-4335-406c-aa5f-eb122161c9fa"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:08.783782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:08.787496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=13 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.788576 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=30 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.798499 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:08.799287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:08.800076 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:08.800758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:08.801237 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:08.801788 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.086267 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-bc9034b0-6b37-4c58-878e-59e594353c63 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312998 Oct 16 01:00:09.087098 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 177/379] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:00:08 2022] POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.366290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:11.368489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:11.371149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=7 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.371801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=56 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:11.377618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.378104 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.378544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.379240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.379703 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.380118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.403157 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lazy-loading 'flavor' on Instance uuid 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:00:11.532873 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-16b52b83-2e53-49e1-87c6-bc3ad4674212 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/action" status: 200 len: 32 microversion: 2.1 time: 0.170517 Oct 16 01:00:11.533829 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 203/380] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:00:11 2022] POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:11.547412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.548117 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:11.559797 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.560399 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.561055 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.561816 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.562280 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.563537 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.703736 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:11.712102 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-41f0a4ab-dfb2-4d77-987f-b0e1a1cd879f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.168954 Oct 16 01:00:11.712697 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 178/381] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:12.740665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.741858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:12.753232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.754868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.755694 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.756956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.757760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.758473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.902159 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:12.910811 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9eb40183-b079-4131-b0a3-a1509e7fddf4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.177216 Oct 16 01:00:12.911359 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 204/382] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:13.937500 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:13.938276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:13.947048 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:13.947688 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:13.948265 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:13.949229 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:13.949831 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:13.950393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:14.094637 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:14.103638 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-def3a2cb-5db3-48f2-8552-bbf3f5477ba3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.172048 Oct 16 01:00:14.104209 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 179/383] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:13 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:15.131419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:15.132430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:15.141336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:15.141832 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:15.142276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:15.142970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:15.143433 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:15.143866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:15.283641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:15.293813 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-26fc6df2-0f88-487a-9453-a1d2f858fa60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.168997 Oct 16 01:00:15.294436 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 205/384] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:15 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:16.326441 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:16.327069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:16.334916 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:16.335482 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:16.335988 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:16.336797 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:16.337380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:16.337875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:16.470282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:16.478986 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8c563ff2-5ce7-4a34-b698-2e2aaebe6b57 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.158843 Oct 16 01:00:16.479556 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 180/385] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:16 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:17.506091 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:17.507086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:17.518252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:17.519067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:17.519820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:17.520993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:17.521751 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:17.522445 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:17.659449 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:17.671593 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fcfa20eb-fb0c-4169-9b35-cf37ba4065ba tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.172150 Oct 16 01:00:17.672302 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 206/386] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:17 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:18.702211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:18.703089 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:18.714114 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:18.714900 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:18.715659 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:18.717286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:18.718046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:18.718740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:18.854299 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:18.864128 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-80200e43-dda0-416e-836e-a7466d7483cb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.168791 Oct 16 01:00:18.864675 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 181/387] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:18 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:19.892135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:19.893191 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:19.903907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:19.904574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:19.905054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:19.905753 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:19.906207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:19.906631 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:20.038263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:20.048896 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3a785a39-4c1b-4473-99be-e498d3c2a5cd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.163457 Oct 16 01:00:20.050337 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 207/388] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:19 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:21.076613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:21.077402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:21.086242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.087119 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.088283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.088615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.089260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.089828 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.231829 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:21.240593 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-659f5514-f1bf-4d49-8316-61f2277a196f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.170635 Oct 16 01:00:21.241204 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 182/389] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:21 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:22.270203 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:22.271200 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:22.282292 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.283086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.283804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.284982 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.285733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.286434 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.419889 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:22.428691 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e7064820-0ce7-4449-b701-dce8437117e6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.165001 Oct 16 01:00:22.429315 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 208/390] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:22 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:23.451999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:23.452549 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:23.459424 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:23.459907 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:23.460339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:23.461319 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:23.461769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:23.462192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:23.594993 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:23.603773 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b32fa33e-de6f-42bb-9050-c6e1604dcde1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.155901 Oct 16 01:00:23.604371 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 183/391] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:23 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:24.627820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:24.628450 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:24.635773 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:24.636284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:24.636741 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:24.637497 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:24.637971 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:24.638411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:24.770341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:24.783043 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9c85ece7-b46c-46d1-9b0b-28c732c56de6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.159082 Oct 16 01:00:24.783828 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 209/392] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:24 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:25.814596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:25.815412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:25.824305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:25.824978 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:25.825556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:25.826465 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:25.827069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:25.827629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:25.967943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:25.976972 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-260610fe-e484-459d-8552-465f3c0be512 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.168554 Oct 16 01:00:25.977536 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 184/393] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:25 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:25.988574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:25.989385 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:25.995930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:25.996408 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:25.996863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:25.997547 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:25.997987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:25.998411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:26.122307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lazy-loading 'services' on Instance uuid 630316f0-8515-4ba3-b433-29c96907a8b2 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:00:26.240741 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-005d17a8-a8f7-4731-a1f3-32adf807c02a tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments/146fcaac-bb7b-4fcd-8430-2550dcabc89f" status: 202 len: 0 microversion: 2.1 time: 0.255927 Oct 16 01:00:26.241393 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 210/394] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:00:25 2022] DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments/146fcaac-bb7b-4fcd-8430-2550dcabc89f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:00:27.001359 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:27.002000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:27.009041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.009531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.009968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.010636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.011092 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.011514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.144141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:27.152972 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-178be981-d78d-4ad5-a669-b7b26c9ece06 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.155540 Oct 16 01:00:27.153810 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 185/395] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:26 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:27.371384 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:27.379590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.380075 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.380581 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.444578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Going to try to stop instance {{(pid=118977) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:00:27.492134 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-83e7a8a0-77f2-4656-8d51-ebaea43ebc70 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.125390 Oct 16 01:00:27.492799 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 211/396] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:00:27 2022] POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:27.501116 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:27.502061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:27.508404 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.509027 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.509475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.510330 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.510801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.511240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.646642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:27.654654 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c01ac3fa-1f97-48ef-ad21-bea1d87bfafd tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.157476 Oct 16 01:00:27.655201 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 186/397] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:27 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:28.181426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:28.182585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:28.190841 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:28.191320 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:28.191756 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:28.192444 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:28.192906 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:28.193357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:28.327470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:28.336168 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-203bb90a-b256-442a-9f6c-03228ba6f695 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.161912 Oct 16 01:00:28.336747 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 212/398] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:28 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:28.682093 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:28.682956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:28.691546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:28.692056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:28.692514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:28.693280 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:28.693763 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:28.694212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:28.834352 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:28.845058 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0e1ef406-ea14-4550-b7ea-0d4c059e1bc6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.169611 Oct 16 01:00:28.845624 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 187/399] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:28 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:29.363792 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:29.364755 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:29.375009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.375494 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.375931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:29.376621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.377106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.377540 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:29.520590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:29.529312 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fe97ad32-a44f-421b-be56-273db47d3469 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.172279 Oct 16 01:00:29.529872 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 213/400] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:29 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:29.868788 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:29.869423 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:29.876582 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.877125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.877590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:29.878316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.878800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.879246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:30.010290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:30.018408 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6f8a0a7d-fafe-4564-b1c5-e7a42db78f2e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.153798 Oct 16 01:00:30.018975 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 188/401] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:29 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:30.553777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:30.554490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:30.562869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:30.563473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:30.564024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:30.564890 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:30.565489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:30.566021 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:30.699697 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:30.708622 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6a159562-030c-49be-9d41-7bebd1a90b12 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.159817 Oct 16 01:00:30.709251 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 214/402] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:30 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:31.046038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:31.047033 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:31.058151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.058915 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.059632 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.060784 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.061709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.062163 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.190215 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:31.198535 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f9f803cb-8b46-47b5-9a37-1c5b3dc4c687 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.159222 Oct 16 01:00:31.199101 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 189/403] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:31 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:31.736368 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:31.737421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:31.747720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.748611 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.749386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.750122 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.750576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.751002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.887371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:31.892357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:31.900733 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8fed39ab-54a4-420d-8fd2-c26f498e12d6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.170653 Oct 16 01:00:31.901505 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 215/404] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:31 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:32.227194 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:32.228152 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:32.237040 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.237523 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.237953 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:32.238633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.239085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.239502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:32.370968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:32.378880 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5c1125cf-6072-4d86-9340-3e693555ccb7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.158743 Oct 16 01:00:32.379474 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 190/405] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:32 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:32.928800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:32.929839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:32.942588 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.943363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.944132 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:32.945342 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.946097 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.946811 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:33.080867 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:33.089760 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2eb41a0f-3b9d-4914-bdb2-8c347905920d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.167396 Oct 16 01:00:33.090531 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 216/406] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:32 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:33.406168 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:33.406925 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:33.415159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:33.415729 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:33.416292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:33.417597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:33.418173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:33.418692 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:33.559393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:33.567335 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7c423247-9e64-4a72-9750-c669deb65831 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.167986 Oct 16 01:00:33.567911 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 191/407] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:33 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:34.120059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:34.120689 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:34.127609 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.128088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.128518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.129268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.129714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.130138 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.257814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:34.266212 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d61ced0f-6a69-4546-90ba-4d214b1247d0 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.150019 Oct 16 01:00:34.266774 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 217/408] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:34 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:34.590940 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:34.591452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:34.598363 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.599087 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.599570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.600352 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.600821 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.601267 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.605458 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:34.741032 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:34.749286 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c1d4b7a2-8465-4f42-a04d-a5959afbcd50 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.162287 Oct 16 01:00:34.749858 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 192/409] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:34 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:35.293984 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:35.294987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:35.302459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.302965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.303422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:35.304141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.304622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.305101 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:35.434574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:35.443558 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e5070bde-b529-4a24-a274-136505a267e1 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.156004 Oct 16 01:00:35.444133 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 218/410] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:35 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:35.776898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:35.777924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:35.788708 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.789559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.790271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:35.791393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.792152 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.792898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:35.925180 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:35.937525 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ed4ce9c8-2dfd-4dbe-a5f5-5059b6f1819d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.166777 Oct 16 01:00:35.938218 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 193/411] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:35 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:36.471235 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:36.472174 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:36.483807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:36.484327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:36.484947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:36.485643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:36.486135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:36.486553 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:36.622736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:36.631167 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-39666d9a-ee8e-472b-ba83-c1297fbbb130 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1736 microversion: 2.1 time: 0.166781 Oct 16 01:00:36.631733 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 219/412] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:36 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:36.965203 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:36.966251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:36.974269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:36.974753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:36.975190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:36.975885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:36.976343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:36.976763 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.117464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:37.125745 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4a4c9a6f-e34d-4245-b9fa-b56430e5238e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.167134 Oct 16 01:00:37.126315 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 194/413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:36 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:37.659036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.659871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:37.670766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.671557 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.672274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.673465 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.674209 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.674903 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.815195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:37.823752 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c996bfd1-2d8b-403a-b6e2-f5c86c68cdb7 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1716 microversion: 2.1 time: 0.171605 Oct 16 01:00:37.824323 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 220/414] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:37 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1716 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:37.941285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.941852 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:37.948222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.948709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.949173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.949864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.950318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.950744 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.087471 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 while it is in vm_state rescued Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Request method failure captured: Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments/954a92c4-4335-406c-aa5f-eb122161c9fa HTTP/1.1 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1az5oSaOP7emFPSnqrD8Qd1eR4w_Tqq513Mv0EvXsbLF5G1I-f_hnNF51zFVaIHGgnlKweosha8QTEyQ9vAwZPh4oJm3x2t1QQkszzTTp61VvjSn_bc79PsTlJkS-JzTdnLQjZ-qqBov-bCdz21vap474ikSqvzL3pOfv9mfi2Aazc Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:00:38.089196 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_18cdea5418644c38bdff444de462b7c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/18cdea5418644c38bdff444de462b7c6"}]}] Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bb8be65b81ca4eee9a524ddb6577d188 Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:00:38.090541 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Cannot 'detach_volume' instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 while it is in vm_state rescued Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'server_id': '0d8a60cb-38d8-43f6-beb8-8808ada4a1b9', 'id': '954a92c4-4335-406c-aa5f-eb122161c9fa'} Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:38.091172 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 while it is in vm_state rescued Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 while it is in vm_state rescued Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:00:38.092342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Returning 409 to user: Cannot 'detach_volume' instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 while it is in vm_state rescued {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:38.093322 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c7171332-cdef-46ab-90cc-3f946272dcf8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments/954a92c4-4335-406c-aa5f-eb122161c9fa" status: 409 len: 152 microversion: 2.1 time: 0.153537 Oct 16 01:00:38.093322 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 195/415] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:00:37 2022] DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments/954a92c4-4335-406c-aa5f-eb122161c9fa => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:38.100089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:38.100648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:38.106768 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.107252 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.107682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.108505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.108952 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.109398 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.148952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:38.149559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:38.156472 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.157003 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.157431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.158171 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.158911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.159298 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.178463 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-eca0f63b-d2db-4cc2-b450-fdbff8110cfc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/action" status: 202 len: 0 microversion: 2.1 time: 0.082251 Oct 16 01:00:38.179276 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 221/416] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:00:38 2022] POST /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:00:38.187500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:38.188207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:38.194363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.194853 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.195265 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.195975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.196436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.196829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.345452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:38.355119 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e1d491b6-1fa6-4e0a-986a-d3034f1065b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.209965 Oct 16 01:00:38.356658 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 196/417] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:38 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:38.378447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:38.386717 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-976547d1-b81c-4d7a-9347-9c3b7d59fe6f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1724 microversion: 2.1 time: 0.203341 Oct 16 01:00:38.387314 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 222/418] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:38 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:39.385152 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:39.385989 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:39.389858 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=41 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:39.398921 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:39.399711 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:39.400428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:39.401693 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:39.402459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:39.403140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:39.411568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:39.412251 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:39.419036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:39.419522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:39.419957 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:39.420642 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:39.421142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:39.421560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:39.597368 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:39.600905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:39.605592 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-438b13f0-eb3b-4a87-a005-1e6d24d122ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.226996 Oct 16 01:00:39.606248 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 197/419] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:39 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:39.609584 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-62993d48-bc44-4ae5-8f03-3f32a909cd4d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1724 microversion: 2.1 time: 0.201837 Oct 16 01:00:39.610115 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 223/420] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:39 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:40.633303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:40.634399 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:40.636521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:40.637557 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:40.645438 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.646263 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.646982 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.648223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.648484 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.649094 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.649376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.649811 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.650065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.650940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.651679 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.652378 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.841195 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:40.844173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:40.850059 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2c26e5dc-d278-4d89-9ef3-12244a255e39 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.223307 Oct 16 01:00:40.850718 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 198/421] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:40 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:40.853475 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0bf2aa3c-8f1c-4e8b-bdca-01230d9b2e02 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1724 microversion: 2.1 time: 0.223292 Oct 16 01:00:40.854031 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 224/422] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:40 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:41.873883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:41.874909 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:41.876194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:41.876806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:41.879298 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=45 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:41.883782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.884214 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.884646 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.885017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.885403 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.885538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.885864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.885982 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.886289 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.886613 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.887066 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.887491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:42.273829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:42.277065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:42.282580 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9ea97a91-a962-4bcd-8bc1-e09a703930fb tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1724 microversion: 2.1 time: 0.410161 Oct 16 01:00:42.283135 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 225/423] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:41 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:42.284992 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a1ad7611-691e-4a8c-8c76-e53c421e8378 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1678 microversion: 2.1 time: 0.415006 Oct 16 01:00:42.285522 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 199/424] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:41 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:43.310117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:43.311390 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:43.311961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:43.312978 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:43.322868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.323810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.324065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.324545 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.324768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.325586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.325980 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.326799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.327006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.327384 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.327490 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.327860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.516031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:43.519063 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:43.524678 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4a4582c2-3b27-4346-aa24-b624e71827dc tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1730 microversion: 2.1 time: 0.221395 Oct 16 01:00:43.525289 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 226/425] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:43 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:43.526841 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b6d97997-4dd9-4f4f-b61f-646249455b1e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1655 microversion: 2.1 time: 0.222043 Oct 16 01:00:43.527399 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 200/426] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:43 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1655 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:43.546747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:43.547237 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:43.549167 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:43.553660 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.554151 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.554589 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.555282 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.555588 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.555715 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.556078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.556177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.556512 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.579728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Going to try to start instance {{(pid=118976) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:00:43.623940 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-447a0f3b-be87-4a9c-ac63-9a87957f1750 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.078598 Oct 16 01:00:43.624793 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 201/427] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:00:43 2022] POST /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:43.635629 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:43.636459 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:43.637929 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-92a3eca6-e37f-4471-8f19-71ec5f8edb61 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095007 Oct 16 01:00:43.638738 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 227/428] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 01:00:43 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:43.644146 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.644705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.646202 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.647277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.647850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.648273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.786791 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:43.794903 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8e8cf315-7738-484e-ab70-3d264a98b0c6 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1664 microversion: 2.1 time: 0.164599 Oct 16 01:00:43.795506 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 202/429] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:43 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:44.819144 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:44.819736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:44.826036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.826527 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.827039 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.827749 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.828194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.828607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.959658 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:44.967333 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-13eebdc3-0b2e-44c9-9e52-27431272b097 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1664 microversion: 2.1 time: 0.152707 Oct 16 01:00:44.967911 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 228/430] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:44 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:45.108336 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:45.118876 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:45.119390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:45.119819 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:45.133446 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] Creating event network-changed:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 01:00:45.138882 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-25c2a388-237b-41af-822a-a880e318e4d5 req-d5018445-4098-454f-b9b3-3c86285264a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Oct 16 01:00:45.139722 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 203/431] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:45.990688 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:45.991394 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:45.998967 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:45.999540 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:46.000031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:46.000796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:46.001336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:46.001825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:46.139388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:46.147538 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9b2046b0-fa64-4da0-80c9-68b9d2804c54 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1668 microversion: 2.1 time: 0.161110 Oct 16 01:00:46.148126 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 229/432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:45 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:47.161466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:47.175410 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.175878 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.176307 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.187403 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] Creating event network-changed:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 01:00:47.192415 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-e55f5b77-c4cd-4f90-85e4-836eef2c7fbf req-f62db966-e947-4a28-b099-8000b1c9ab22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038782 Oct 16 01:00:47.193004 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 204/433] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:06.018916 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.019780 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.023363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=9 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.024470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.030382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.030866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.031302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.031997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.032453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.032896 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.062450 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bffb63b2-2f61-4e93-a01a-f49790a80e6c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments/295e4b2b-8e36-41a8-89d0-cf52c0d9cffe" status: 200 len: 194 microversion: 2.20 time: 0.050290 Oct 16 01:01:06.063017 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 230/434] 10.222.0.13 () {60 vars in 1454 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments/295e4b2b-8e36-41a8-89d0-cf52c0d9cffe => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:06.137365 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=15 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.138107 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.142603 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.143176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.150593 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.151070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.151505 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.152192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.152642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.153158 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.346192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lazy-loading 'services' on Instance uuid b12648b0-9359-4569-82b6-3e6fe3d53d6f {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:06.470253 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4202561e-799f-4983-be68-75b34de4876b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments/295e4b2b-8e36-41a8-89d0-cf52c0d9cffe" status: 202 len: 0 microversion: 2.20 time: 0.334356 Oct 16 01:01:06.474307 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 205/435] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 16 01:01:06 2022] DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments/295e4b2b-8e36-41a8-89d0-cf52c0d9cffe => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:06.480689 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.483060 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.490032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.490527 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.491031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.491736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.492195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.492647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.525813 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-804fea2a-47a6-42bf-adbc-e3f63696b1ca tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050028 Oct 16 01:01:06.526493 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 231/436] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:01:07.540004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:07.542283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:07.548636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.549155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.549566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.550261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.550709 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.551131 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.581011 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-380d759e-23f8-40e4-8faf-1ab42fe8d60e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045773 Oct 16 01:01:07.581580 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 206/437] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 16 01:01:07 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:07.644783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:07.645332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:07.652125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.652546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.653020 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.653711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.654197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.654622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.680331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:07.759699 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b7a17437-bc53-4a3a-a62e-5c52be78f3b3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 204 len: 0 microversion: 2.20 time: 0.118534 Oct 16 01:01:07.760517 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 232/438] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 16 01:01:07 2022] DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:01:07.768818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:07.769456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:07.777685 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.778171 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.778743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.780351 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.780815 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.781271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.915485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:07.924209 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:07.925678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:07.926824 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4dd77dfa-523c-4ad4-bc92-197bc8c8b14d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.161974 Oct 16 01:01:07.927413 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 207/439] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:07 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:01:08.956779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.958023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:08.966137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.966625 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.967058 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.967748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.968198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.968615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.157583 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:09.165919 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:09.167362 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:09.168519 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0ff29612-edf5-4f4b-89c3-d61e3cd98eef tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.218898 Oct 16 01:01:09.169128 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 233/440] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:10.193862 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:10.194470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:10.201456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.201959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.202415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.203086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.203540 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.204297 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.333870 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.342917 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.344243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.345468 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-25b191a5-8566-42e5-986b-270429aaf3a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1722 microversion: 2.20 time: 0.155554 Oct 16 01:01:10.346059 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 208/441] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:10 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:11.048057 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12648b0-9359-4569-82b6-3e6fe3d53d6f", "name": "network-vif-deleted", "tag": "a0cb2df3-616a-43d9-bdfa-2e08c82d3c35"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:11.064475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.064993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.065409 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.078465 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] Creating event network-vif-deleted:a0cb2df3-616a-43d9-bdfa-2e08c82d3c35 for instance b12648b0-9359-4569-82b6-3e6fe3d53d6f on hv-cinder-maste Oct 16 01:01:11.083809 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-0fadca3e-7e34-4012-98ea-64d2f97ab725 req-f34d5324-e81f-489a-8c9c-0e6465d4daf7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046699 Oct 16 01:01:11.084430 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 234/442] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:11.371140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.371884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:11.378533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.379007 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.379605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.380647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.381436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.381889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.421971 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.422686 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.423339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.423786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lazy-loading 'fault' on Instance uuid b12648b0-9359-4569-82b6-3e6fe3d53d6f {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:11.465731 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.474612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.476049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.477609 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f99bd977-8d35-4674-abfa-36901413974c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 200 len: 1370 microversion: 2.20 time: 0.110538 Oct 16 01:01:11.478558 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 209/443] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:11 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:12.503873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.504689 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:12.511463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.511940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.512373 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.513071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.513516 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.513934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.527128 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f HTTP/1.1 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:01:12.528914 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:01:12.530562 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'b12648b0-9359-4569-82b6-3e6fe3d53d6f'} Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:12.531517 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:01:12.532691 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.533806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:12.533806 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d2432833-e0e7-401d-bc4a-4f6d683b1460 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 404 len: 111 microversion: 2.20 time: 0.031121 Oct 16 01:01:12.533806 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 235/444] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:01:12.539578 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3b3a82ab-9e26-4601-b70a-65f23b301909 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '.version_select at 0x7f5806ffdb80>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.562282 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3b3a82ab-9e26-4601-b70a-65f23b301909 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329458898" status: 204 len: 0 microversion: 2.20 time: 0.026719 Oct 16 01:01:12.562913 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 210/445] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 16 01:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329458898 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:01:13.209230 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3aa1dbfa-5ac0-4641-bf2a-faec5d39b702 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: .version_select at 0x7f58070309d0>, body: {"keypair": {"name": "tempest-keypair-2063555069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLHTwGpWZNIlMwTO1WKCvO10rvUnQipHwb+GwKbdHqDmNgdyYBi7NtghKDxSeOLR9izMLhqaNxYNRnPiQn1CGllI69QKqxmkoJeHaMOvp8kSwgZKD3sTxKzUIXe9d5vBg=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:13.225076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-3aa1dbfa-5ac0-4641-bf2a-faec5d39b702 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:13.229173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-3aa1dbfa-5ac0-4641-bf2a-faec5d39b702 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for user 6538a3de44cd4650b31aab5f169a8abe and project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:13.253552 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3aa1dbfa-5ac0-4641-bf2a-faec5d39b702 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048272 Oct 16 01:01:13.254058 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 236/446] 10.222.0.13 () {62 vars in 1200 bytes} [Sun Oct 16 01:01:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:01:14.534985 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-625110972", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2751c9ed-756d-4ad3-a0df-a613fb9d3d22"}], "security_groups": [{"name": "tempest-securitygroup--1850857302"}], "key_name": "tempest-keypair-2063555069", "user_data": "}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:14.639273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] validate_networks() for [('2751c9ed-756d-4ad3-a0df-a613fb9d3d22', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:15.018714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:15.019139 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:15.019634 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:15.020038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:15.020451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:15.030342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.030826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.031254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.031977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.032432 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.032872 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.051417 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:15.055943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Getting quotas for user 6538a3de44cd4650b31aab5f169a8abe and project 4a2d5b3b740743ba9bba7dcf77214252. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:15.068098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:15.070418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:15.120474 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b003c457-8912-4daa-b01b-7beeec2dd543 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.593085 Oct 16 01:01:15.121186 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 211/447] 10.222.0.13 () {62 vars in 1188 bytes} [Sun Oct 16 01:01:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:01:15.132432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:15.133084 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:15.189223 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:15.196696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:15.198281 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:15.199377 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-dc98dc83-da8f-4457-b556-b170d71623b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1281 microversion: 2.20 time: 0.071015 Oct 16 01:01:15.200699 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 237/448] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:15 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:16.228868 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:16.229435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:16.236100 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.236574 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.237042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.237728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.238178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.238593 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.312760 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.321548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.322968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.324042 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4adefbf0-12ba-45e6-b52e-7083854e911d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1333 microversion: 2.20 time: 0.102237 Oct 16 01:01:16.324601 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 212/449] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:16 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:17.357672 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.359000 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:17.365621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.366436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.366851 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.367806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.368435 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.368973 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.522773 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.531716 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.533474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.535437 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d3e43ab0-ac5a-4ac4-94d7-7541a2b058db tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.181811 Oct 16 01:01:17.536169 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 238/450] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:18.048184 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:18.059355 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.060099 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.060731 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.071645 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] Creating event network-changed:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:01:18.076427 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-afc35132-6214-4364-9f2a-cec8cb1c3b87 req-95c13265-6b8d-4b84-a084-a89ce171e2b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032014 Oct 16 01:01:18.077103 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 213/451] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:18.622027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.622668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:18.629079 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.629589 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.630015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.630701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.631155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.631599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.762514 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:18.771228 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:18.772655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:18.773792 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bf958e04-93b5-4158-8d90-c37c7f816eac tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.215822 Oct 16 01:01:18.774442 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 239/452] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:19.803810 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:19.804987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:19.815484 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.816294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.817047 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.818223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.818989 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.819687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.961719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:19.970645 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:19.972369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:19.973803 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e55847d8-a9a9-4874-8f60-fa30b97f3959 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.177863 Oct 16 01:01:19.974355 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 214/453] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:19 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:21.003720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:21.004723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:21.008458 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:01:21.008886 dv-cinder-master-3-smb devstack@n-api.service[118977]: Sun Oct 16 01:01:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 (ip 10.222.0.13) !!! Oct 16 01:01:21.019785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.020593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.021367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.022528 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.023267 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.023968 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.170970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.179972 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.181557 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.182668 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-76cf7185-9082-4b80-bef6-d35210fed2aa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.185529 Oct 16 01:01:21.183211 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 240/454] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:20 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:22.211350 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.212332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:22.224059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.224875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.225599 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.226730 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.227474 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.228166 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.364358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.372888 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.374364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.375463 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-83b34afd-5449-42ba-85d6-74550aa19f40 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.170666 Oct 16 01:01:22.376019 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 215/455] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:23.403178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.403806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.411575 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.412120 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.412596 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.413413 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.413930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.414395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.543093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.551620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.553071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.554174 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c2236461-34bb-49d3-9d37-7eeeb03ea801 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.156536 Oct 16 01:01:23.554727 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 241/456] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:23.771514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.772268 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.783157 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.783969 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.784691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.785938 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.786702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.787449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.811907 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-29243825-755e-4524-92f8-a130771be936 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/ips" status: 200 len: 150 microversion: 2.1 time: 0.047265 Oct 16 01:01:23.812464 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 216/457] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:23.825321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a0b48dc-29ac-47d3-a3d9-893498ea1fa2"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:23.827759 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.834108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.834595 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.835032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.835729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.836184 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.836604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.925282 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: POST /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/os-volume_attachments HTTP/1.1 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 74 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:01:23.927907 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: {"volumeAttachment": {"volumeId": "3a0b48dc-29ac-47d3-a3d9-893498ea1fa2"}} Oct 16 01:01:23.929307 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'server_id': 'b4434ad0-46fe-4731-affd-44c026f7f955', 'body': {'volumeAttachment': {'volumeId': '3a0b48dc-29ac-47d3-a3d9-893498ea1fa2'}}} Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.930072 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:23.931886 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 400 to user: Invalid volume: volume 3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 is already attached to instances: 511846b5-6613-4b20-8550-31b4067e1da2 {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ca1fb883-2ea5-48be-b0bc-36cf25c29d6f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108239 Oct 16 01:01:23.933585 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 242/458] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:01:23 2022] POST /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:01:23.938396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.938888 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.945040 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.945580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.946017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.947918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.948324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.948878 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.975342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:24.060141 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-91e1e50d-c4c5-4184-ac30-a10c6548aa6d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 204 len: 0 microversion: 2.1 time: 0.125260 Oct 16 01:01:24.061285 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 217/459] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:23 2022] DELETE /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:24.069600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.070218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.077452 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.077934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.078375 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.079065 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.079522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.079941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.209915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.217888 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-10cc9a1f-8b8a-445a-b231-251269b45918 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1681 microversion: 2.1 time: 0.152142 Oct 16 01:01:24.218455 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 243/460] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:24.584231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.585452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.592599 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.593121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.593548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.594228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.594673 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.595087 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.735138 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.743247 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.744722 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.745844 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-663fe85f-21d6-4aef-b7f0-03805a43a910 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.168715 Oct 16 01:01:24.746375 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 218/461] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:25.246000 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.247025 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.250792 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:25.259789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.260276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.260716 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.261440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.261893 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.262316 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.400286 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.408052 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-db615314-30dc-4b29-9400-c0b510c13696 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1681 microversion: 2.1 time: 0.168921 Oct 16 01:01:25.408627 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 244/462] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:25.646933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "name": "network-vif-plugged", "status": "completed", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:25.652589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:25.653315 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:25.659316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.660027 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.660648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.675370 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] Creating event network-vif-plugged:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:01:25.680432 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-f4b0bc17-71d0-4ed7-91db-b12bdc8a1965 req-72d039bd-0ec3-4b58-9094-98cc270cdec2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Oct 16 01:01:25.681268 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 219/463] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:25.774169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.775163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.785526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.786330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.787052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.788188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.789034 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.789750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.926636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.935216 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.936939 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.938033 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f3eae109-75c4-4afc-97aa-255375b20707 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.170483 Oct 16 01:01:25.938556 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 245/464] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:26.431944 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.432638 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.438929 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.439421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.439837 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.440524 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.442183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.442610 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.574619 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.584511 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6e051dab-a074-4e45-9a21-71b2f64bb4cd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1681 microversion: 2.1 time: 0.156276 Oct 16 01:01:26.584756 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 220/465] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:26.874975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4434ad0-46fe-4731-affd-44c026f7f955", "name": "network-vif-deleted", "tag": "c6ac8b52-0df2-4f03-9e5b-3268cab7db97"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:26.885847 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.886247 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.886675 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.900968 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] Creating event network-vif-deleted:c6ac8b52-0df2-4f03-9e5b-3268cab7db97 for instance b4434ad0-46fe-4731-affd-44c026f7f955 on hv-cinder-maste Oct 16 01:01:26.906461 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-c4ee1a10-46bb-4d7b-a838-5bcfd099ee8c req-0ba59d40-5e6a-455f-8c9f-feaed46234d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Oct 16 01:01:26.907229 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 246/466] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:26.963452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.964002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.970636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.971122 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.971767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.972497 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.973396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.973821 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.111322 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.119541 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.121009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.122141 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8872b0dc-c065-4251-853e-bd8cb1be84ed tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1407 microversion: 2.20 time: 0.162792 Oct 16 01:01:27.122704 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 221/467] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:27.608015 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:27.608698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:27.615092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.615577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.616012 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.616711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.617198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.617619 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.649365 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.649849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.650346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.650790 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'fault' on Instance uuid b4434ad0-46fe-4731-affd-44c026f7f955 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:27.696187 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.704445 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3d6424f2-7f00-4b45-b53f-4fe682bf3064 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 200 len: 1332 microversion: 2.1 time: 0.100707 Oct 16 01:01:27.705035 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 247/468] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:27 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:28.147353 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.147979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.155053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.155543 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.155984 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.156677 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.157174 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.157581 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.161727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.293741 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.303091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.304547 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.305722 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f4144bfd-be76-4e95-b809-c46da4b36e9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1599 microversion: 2.20 time: 0.162476 Oct 16 01:01:28.306382 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 222/469] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:01:28.330087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.330608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.337406 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.337917 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.338343 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.339097 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.339482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.339897 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.357123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.419772 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8c1f6799-ce97-47d5-aa53-20e1b4f5a3d2 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093206 Oct 16 01:01:28.420628 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 248/470] 10.222.0.13 () {60 vars in 1316 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:28.728179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.728828 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.735132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.735601 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.736029 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.736718 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.737201 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.737616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.750882 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 HTTP/1.1 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:01:28.752521 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:01:28.754130 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'b4434ad0-46fe-4731-affd-44c026f7f955'} Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:28.754982 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:01:28.756342 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:28.757600 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:28.757600 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1db8504f-22d2-4f39-85c9-2c20cac05d5e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 404 len: 111 microversion: 2.1 time: 0.029804 Oct 16 01:01:28.758136 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 223/471] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:28.763074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-27a3a76d-db45-4648-b7c1-e79fef9bf2cf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '.version_select at 0x7f5807074700>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.785582 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-27a3a76d-db45-4648-b7c1-e79fef9bf2cf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813694886" status: 202 len: 0 microversion: 2.1 time: 0.026384 Oct 16 01:01:28.786256 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 249/472] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 16 01:01:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813694886 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:01:29.933753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:29.944776 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.945295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.945715 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.957506 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] Creating event network-changed:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:01:29.962722 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-37d0eccc-f008-4ea6-bd9b-547925755b05 req-41c0638d-b947-4462-8914-9fbd87ced6e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Oct 16 01:01:29.963748 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 224/473] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:30.019181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.019726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:30.026581 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.027185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.027511 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.028241 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.028908 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.029496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.127642 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'services' on Instance uuid 511846b5-6613-4b20-8550-31b4067e1da2 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:30.205320 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-05385879-1e77-4d09-a8a7-009086a461b9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments/3a0b48dc-29ac-47d3-a3d9-893498ea1fa2" status: 202 len: 0 microversion: 2.1 time: 0.190516 Oct 16 01:01:30.209167 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 250/474] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:01:30 2022] DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments/3a0b48dc-29ac-47d3-a3d9-893498ea1fa2 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:30.216600 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.219264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:30.225961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.226472 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.227132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.227694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.228260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.228793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.262358 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-156cbaab-0ba4-4df8-a512-eb0ceeaf255f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050540 Oct 16 01:01:30.263242 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 225/475] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:31.279940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.283107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.291552 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.292205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.292777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.293714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.294315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.294865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.327782 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9a06ba1b-96b5-413a-8b91-a882c72d6c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055016 Oct 16 01:01:31.328340 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 251/476] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:31.394004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.394526 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.401451 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.401932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.402324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.403036 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.403486 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.403906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.431145 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:31.509882 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6b0fec03-3f98-476d-9823-0225492c21f1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 204 len: 0 microversion: 2.1 time: 0.118754 Oct 16 01:01:31.510757 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 226/477] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:31 2022] DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:01:31.519752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.520372 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.526736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.527232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.527704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.528397 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.528865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.529299 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.658498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.666652 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-49adc384-4001-4ac1-a744-9a9a3bc8d0dc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1681 microversion: 2.1 time: 0.151026 Oct 16 01:01:31.667220 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 252/478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:32.704772 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.705948 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:32.715279 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.715759 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.716188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.716873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.717359 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.717777 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.850097 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.861625 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-54789d50-fdbe-4dc8-86b2-10095c4d66b1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1681 microversion: 2.1 time: 0.163704 Oct 16 01:01:32.862433 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 227/479] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:33.887715 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.888293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:33.894882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.895371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.895783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.896497 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.896947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.897405 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.032156 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.040302 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7ca72e42-d577-478d-83cf-97d2caef2fdd tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1681 microversion: 2.1 time: 0.156687 Oct 16 01:01:34.040916 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 253/480] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:34.493223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511846b5-6613-4b20-8550-31b4067e1da2", "name": "network-vif-deleted", "tag": "3e27aa79-19be-43f6-92b8-258048ba4a37"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:34.503585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.504071 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.504503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.518763 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] Creating event network-vif-deleted:3e27aa79-19be-43f6-92b8-258048ba4a37 for instance 511846b5-6613-4b20-8550-31b4067e1da2 on hv-cinder-maste Oct 16 01:01:34.524123 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-8133fe1d-826d-49d4-9053-512e079b5f8e req-f47b14e9-b4a9-46aa-a68a-d893b1e12c3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101719 Oct 16 01:01:34.526053 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 228/481] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:35.063825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:35.064463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:35.071805 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.072308 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.072734 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.073456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.073907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.074338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.112462 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.113074 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.113509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.113960 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'fault' on Instance uuid 511846b5-6613-4b20-8550-31b4067e1da2 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:35.159904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.167840 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7ed73a44-8b09-45d5-8932-18225d1fc0d3 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 200 len: 1332 microversion: 2.1 time: 0.107798 Oct 16 01:01:35.168414 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 254/482] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:35 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:36.197335 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:36.197954 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:36.199911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:36.207720 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.208675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.209246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.210105 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.210826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.211461 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.229456 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 HTTP/1.1 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:01:36.231207 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:01:36.232531 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '511846b5-6613-4b20-8550-31b4067e1da2'} Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:36.233290 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:01:36.234392 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:36.235384 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:36.235384 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3c262cb7-6bcc-4ee1-a252-c8ce811a21a4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 404 len: 111 microversion: 2.1 time: 0.043739 Oct 16 01:01:36.235384 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 229/483] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:36 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:36.241772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-48987cce-f414-4745-b40d-a607f66a2f1b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '.version_select at 0x7f5806ef8040>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:36.249076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:36.263289 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-48987cce-f414-4745-b40d-a607f66a2f1b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058823314" status: 202 len: 0 microversion: 2.1 time: 0.025384 Oct 16 01:01:36.263842 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 255/484] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 16 01:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058823314 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:36.887243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-02fde65a-dd91-4761-a443-bf8de01d1a3f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: .version_select at 0x7f58070aeaf0>, body: {"keypair": {"name": "tempest-keypair-75206919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhXue6ilOQRo+RGLmurjwWFhmCXzYvvJUqfsjyfH3H3MroSY2YuFGeO+snqBdA70Rm/ETxnjA4voEHtprS+6Ckc7HynoTm/wN8+wg+vbjTWwN5ylZlxr0FyPeEt72CCtw=="}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:36.903076 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-02fde65a-dd91-4761-a443-bf8de01d1a3f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:36.907116 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-02fde65a-dd91-4761-a443-bf8de01d1a3f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:36.933403 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-02fde65a-dd91-4761-a443-bf8de01d1a3f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050431 Oct 16 01:01:36.933955 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 230/485] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 01:01:36 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:38.155175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1557001166", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3913489d-de8f-457c-b3d2-8d2ca6fdbe30"}], "security_groups": [{"name": "tempest-securitygroup--255406870"}], "key_name": "tempest-keypair-75206919", "user_data": "}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:38.263157 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] validate_networks() for [('3913489d-de8f-457c-b3d2-8d2ca6fdbe30', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:38.705883 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:38.706291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:38.706761 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:38.707187 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:38.707591 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:38.716860 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.717352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.717781 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.718495 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.718946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.719367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.735996 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:38.739875 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:38.750644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:38.752961 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:38.804326 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-efb824da-76df-460a-bf9c-b6c93cede159 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656814 Oct 16 01:01:38.805196 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 256/486] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:01:38.816903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c3d70317-732c-49fb-9858-d1a4af6f56c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.817509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c3d70317-732c-49fb-9858-d1a4af6f56c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:38.871476 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c3d70317-732c-49fb-9858-d1a4af6f56c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.878483 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c3d70317-732c-49fb-9858-d1a4af6f56c9 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1240 microversion: 2.1 time: 0.065951 Oct 16 01:01:38.879066 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 231/487] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:39.902223 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:39.902881 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:39.909127 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.909608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.910032 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.910712 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.911190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.911603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.983120 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:39.991058 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4976f48e-eab6-412b-b651-91dce2acae31 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1292 microversion: 2.1 time: 0.093542 Oct 16 01:01:39.991609 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 257/488] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:39 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:41.018070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:41.018644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:41.026838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.027401 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.028092 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.028876 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.029482 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.030319 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.173242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.181963 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-674f8274-fa68-4450-a926-ae75d26d9c03 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.167853 Oct 16 01:01:41.182619 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 232/489] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:41 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:41.727963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffecdc47-2f1e-48ca-a824-f5a3be48730d", "tag": "e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:41.738932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.739546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.740141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.751975 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] Creating event network-changed:e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17 for instance ffecdc47-2f1e-48ca-a824-f5a3be48730d on hv-cinder-maste Oct 16 01:01:41.756850 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-bb3ea12a-c499-466c-b79a-7d3842f3a1c7 req-53c2f978-5bf4-4bdb-8511-0058a821d96e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033744 Oct 16 01:01:41.757693 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 258/490] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:42.205605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:42.206211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:42.214196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.214714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.215152 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.215850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.216305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.216726 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.355608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.363569 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3df95175-06cd-469d-8361-54a68706f178 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.162311 Oct 16 01:01:42.364134 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 233/491] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:42 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:43.386852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:43.387440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:43.394669 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.395153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.395586 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.396278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.396736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.397191 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.525730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:43.537151 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0457933b-ccca-4adf-8e49-7d3b321209e1 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.154368 Oct 16 01:01:43.537930 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 259/492] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:43 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:44.559752 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:44.560332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:44.567313 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.567795 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.568231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.568959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.569430 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.569871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.701108 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.709036 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-73395242-7279-4107-b724-e46ebc8b8c06 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.153156 Oct 16 01:01:44.709615 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 234/493] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:44 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:45.733158 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.734349 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.741799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.742545 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.743340 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.744240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.744735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.745245 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.827831 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.830382 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.837137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.837623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.838058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.838750 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.839200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.839618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.868961 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9df581e2-83ca-468e-9534-f3cbea777c7d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045224 Oct 16 01:01:45.869541 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 235/494] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:45 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:01:45.876201 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:45.884126 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f1467fef-91af-48e1-a17b-281bb9e6d512 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.156378 Oct 16 01:01:45.884688 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 260/495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:45 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:45.933337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.933832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.940171 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.940651 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.941112 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.941806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.942256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.942675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.967281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:46.053057 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6acdd826-404b-4484-9411-fdfeb51cb173 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 204 len: 0 microversion: 2.1 time: 0.123487 Oct 16 01:01:46.053644 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 236/496] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:45 2022] DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:46.062372 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.063009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:46.069415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.070487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.071173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.071844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.072309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.072737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.206620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:46.214535 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-600341bc-49c5-4e92-9520-74a0b04bf905 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1674 microversion: 2.1 time: 0.156373 Oct 16 01:01:46.215087 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 261/497] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:46.907644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.908427 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:46.915131 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.915615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.916207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.916958 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.917435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.917855 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.050608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.062708 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-84cf342e-6516-446b-8d2b-33a4d3b7eb11 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.159280 Oct 16 01:01:47.063558 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 237/498] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:47.242108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:47.242948 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:47.255965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.257051 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.257783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.258939 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.259727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.260416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.394376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.402460 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a4fee418-5fe0-4932-8a54-ef73a33ade07 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1674 microversion: 2.1 time: 0.166994 Oct 16 01:01:47.403036 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 262/499] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:47 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:47.745324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffecdc47-2f1e-48ca-a824-f5a3be48730d", "name": "network-vif-plugged", "status": "completed", "tag": "e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:47.755161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.755630 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.756059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.768220 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] Creating event network-vif-plugged:e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17 for instance ffecdc47-2f1e-48ca-a824-f5a3be48730d on hv-cinder-maste Oct 16 01:01:47.773167 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-e99f8686-46bb-4baa-84df-48df16875587 req-0fad52dc-d0cc-4c49-b23f-d37c2f222dac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031448 Oct 16 01:01:47.773757 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 238/500] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:48.090279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:48.091351 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:48.098231 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.098809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.099440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.100188 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.100646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.101129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.237204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:48.244968 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e0790eb2-268e-4bbb-9190-3973f8c7b01f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.158713 Oct 16 01:01:48.245536 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 263/501] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:48 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:48.431360 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:48.432544 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:48.440662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.441214 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.441653 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.442348 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.442805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.443226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.577149 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:48.585387 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6f52ae9a-8141-406e-ad13-15ea6dede4b0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1674 microversion: 2.1 time: 0.161835 Oct 16 01:01:48.585956 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 239/502] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:48 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:48.752774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:48.753296 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:48.755700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:48.756461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:48.762594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.763078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.763509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.764269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.764728 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.765172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.846275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lazy-loading 'services' on Instance uuid 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:48.923750 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-da30c391-c9a5-4f9b-b984-17dc11d7659b tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments/954a92c4-4335-406c-aa5f-eb122161c9fa" status: 202 len: 0 microversion: 2.1 time: 0.174729 Oct 16 01:01:48.924345 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 264/503] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:01:48 2022] DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments/954a92c4-4335-406c-aa5f-eb122161c9fa => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:48.932699 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:48.934892 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:48.937058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:48.942542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.943022 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.943453 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.944149 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.944594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.945049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.971623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:48.978314 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-29e5b331-e91b-4753-a2ea-444526901926 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Oct 16 01:01:48.978884 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 240/504] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:48 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:49.268705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.269471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:49.275852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.276359 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.276796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.277523 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.277980 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.278410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.410369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.418538 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-adfdf7b0-936e-459c-b0ae-953e2f5775bc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1365 microversion: 2.1 time: 0.154334 Oct 16 01:01:49.419081 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 265/505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:49.609161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.609806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:49.617453 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.617935 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.618376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.619066 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.619525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.619951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.752868 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.761284 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-46ed8150-7a5d-43da-876b-945043074b09 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1674 microversion: 2.1 time: 0.155972 Oct 16 01:01:49.761869 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 241/506] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:49.991314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.993745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:50.000335 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.000743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.001216 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.001913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.002374 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.002796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.036047 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e66d0b8a-8f34-48d2-aed5-713d960a9ac8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048625 Oct 16 01:01:50.036638 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 266/507] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:50.442894 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:50.443586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:50.451133 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.451633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.452068 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.452781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.453282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.453708 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.551813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630316f0-8515-4ba3-b433-29c96907a8b2", "name": "network-vif-deleted", "tag": "a781e62b-4499-48b4-bb7f-86dce780562d"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:50.561510 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.562482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.562482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.566377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:50.574526 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] Creating event network-vif-deleted:a781e62b-4499-48b4-bb7f-86dce780562d for instance 630316f0-8515-4ba3-b433-29c96907a8b2 on hv-cinder-maste Oct 16 01:01:50.579732 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-768f0e13-9dd6-4809-badf-de3e1c50ad8e req-22e9a407-c69c-43fd-b903-f4678ee3093d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Oct 16 01:01:50.580512 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 267/508] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:50.598885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:50.608125 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cc014a77-78fa-4c4a-8c9a-5d47d1db46d2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1555 microversion: 2.1 time: 0.169569 Oct 16 01:01:50.608934 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 242/509] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:50 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:50.631732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:50.632529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:50.640645 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.641167 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.641608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.642358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.642815 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.643242 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.735474 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ef689ca6-b497-4686-90cc-ce4491baa24f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108344 Oct 16 01:01:50.736215 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 268/510] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 01:01:50 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:50.783649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:50.784392 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:50.791008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.791769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.792589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.793561 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.794812 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.795514 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.867080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:50.875836 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4e823330-35eb-4d4d-8dea-0bcc875d4dcc tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 200 len: 1322 microversion: 2.1 time: 0.096158 Oct 16 01:01:50.880464 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 243/511] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:50 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:51.048534 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:51.050820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:51.068784 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.069423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.069871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.070579 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.071202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.071770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.153230 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4735ecfe-41ef-43bb-9c16-24c1697b58af tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108322 Oct 16 01:01:51.155275 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 269/512] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:51 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:51.899113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:51.899662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:51.906628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.907125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.907566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.908255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.908716 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.909179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.922783 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 HTTP/1.1 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:01:51.924446 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:01:51.925967 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '630316f0-8515-4ba3-b433-29c96907a8b2'} Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:51.926835 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:01:51.928053 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:51.929516 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:51.929516 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3a742bd3-194b-45d9-a03c-c8309d8a8193 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 404 len: 111 microversion: 2.1 time: 0.030982 Oct 16 01:01:51.929516 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 244/513] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:51 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:51.935200 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-479233ff-a226-4cc8-8431-75bb074905ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '.version_select at 0x7f5806ef8040>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:51.956258 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-479233ff-a226-4cc8-8431-75bb074905ba tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823826492" status: 202 len: 0 microversion: 2.1 time: 0.024829 Oct 16 01:01:51.956984 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 270/514] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 16 01:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823826492 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:52.167340 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.169924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.176074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.176584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.177191 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.178356 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.178356 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.178752 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.208446 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e9267153-ae19-491f-90d5-99d925d71442 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045308 Oct 16 01:01:52.212939 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 245/515] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:01:52 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:52.288411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.289036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.296257 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.296862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.297392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.298172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.298860 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.299365 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.326563 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:52.409649 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-47e59875-e668-419a-9c8b-a4bad506a787 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 204 len: 0 microversion: 2.1 time: 0.124871 Oct 16 01:01:52.410555 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 271/516] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:52 2022] DELETE /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:52.420128 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.420980 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.427526 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.428176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.428856 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.429584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.430050 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.430473 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.595615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffecdc47-2f1e-48ca-a824-f5a3be48730d", "tag": "e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:52.606476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.606997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.607417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.620605 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] Creating event network-changed:e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17 for instance ffecdc47-2f1e-48ca-a824-f5a3be48730d on hv-cinder-maste Oct 16 01:01:52.626087 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-e5328091-8596-4d8c-acfd-cb2214949baf req-7124d257-8dd9-4e1b-a272-a1754494b177 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Oct 16 01:01:52.626988 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 272/517] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:52.851536 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:52.862930 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-532520e4-4cc3-44f9-bb0a-4a0444935506 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1690 microversion: 2.1 time: 0.447054 Oct 16 01:01:52.863508 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 246/518] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:52 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:52.881280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b8641178-fab8-47bb-b7b6-b47f7dafd294 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: .version_select at 0x7f5806f4c8b0>, body: {"keypair": {"name": "tempest-keypair-87686608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLyL1K9sPI3RSza7LQnSUINMy2CVpR6OP2bIRijsGV8IDMCvqoVKtEGGX2G3zYDBTbsn6QphHomlsch0WnGyXEG8YNrEGUrMf4BCcuM4nbnrxBojuDgAhXG7MTVhbvBw=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:52.897301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-b8641178-fab8-47bb-b7b6-b47f7dafd294 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for project 467164d5c9154ed5ad79e0257e95de97. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:52.901651 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-b8641178-fab8-47bb-b7b6-b47f7dafd294 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for user 63527c420b154db4abb6e832e46ccd05 and project 467164d5c9154ed5ad79e0257e95de97. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:52.926406 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b8641178-fab8-47bb-b7b6-b47f7dafd294 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049387 Oct 16 01:01:52.927036 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 273/519] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 01:01:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:53.886779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:53.887361 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.894326 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.894825 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.895258 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.895958 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.896397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.896818 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.026941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:54.034831 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-48973a93-f84f-49a8-9baa-aa4e94445c9d tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1690 microversion: 2.1 time: 0.152049 Oct 16 01:01:54.035376 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 247/520] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:53 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:54.155679 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-391318408", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385d8cb9-6173-49a8-a000-9036557916d2"}], "security_groups": [{"name": "tempest-securitygroup--804834575"}], "key_name": "tempest-keypair-87686608", "user_data": "}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:54.262159 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] validate_networks() for [('385d8cb9-6173-49a8-a000-9036557916d2', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:54.648104 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:54.648526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:54.649049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:54.649454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:54.649865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:54.659426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.659905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.660332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.661093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.661547 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.662126 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.678827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for project 467164d5c9154ed5ad79e0257e95de97. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:54.683185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Getting quotas for user 63527c420b154db4abb6e832e46ccd05 and project 467164d5c9154ed5ad79e0257e95de97. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:54.695237 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:54.697722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:54.747425 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8250b19d-2b81-4e1f-ae59-f54a7653fe24 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596688 Oct 16 01:01:54.748061 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 274/521] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:54.759207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9cb7e8b8-f037-4edb-9f8c-d919fa4716f7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:54.759811 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9cb7e8b8-f037-4edb-9f8c-d919fa4716f7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:54.812324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9cb7e8b8-f037-4edb-9f8c-d919fa4716f7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:54.819182 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9cb7e8b8-f037-4edb-9f8c-d919fa4716f7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1235 microversion: 2.1 time: 0.063832 Oct 16 01:01:54.819745 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 248/522] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:54 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:55.057958 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:55.058579 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:55.064989 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.065479 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.065948 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.066643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.067098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.067523 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.198176 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.209930 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-55b81516-c56f-4204-b79f-280168f8cb25 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1690 microversion: 2.1 time: 0.155598 Oct 16 01:01:55.210652 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 275/523] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:55 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:55.842608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:55.843173 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:55.850675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.851206 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.851725 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.852458 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.852968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.853390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.918085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.925813 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e54413b5-52da-4860-981a-9bb032ab1289 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1287 microversion: 2.1 time: 0.087463 Oct 16 01:01:55.926398 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 249/524] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:55 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:56.235923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:56.237191 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:56.243723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.244271 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.244766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.245621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.246125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.246548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.378296 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:56.386468 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-86c4cc03-3335-42e2-83a1-451cda2d375f tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1690 microversion: 2.1 time: 0.154652 Oct 16 01:01:56.387029 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 276/525] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:56 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:56.949488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:56.950098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:56.956968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.957452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.957892 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.958610 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.959069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.959488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.024334 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:57.032405 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6b9fadc8-01c3-4777-8757-394f61f3ad3c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1293 microversion: 2.1 time: 0.086905 Oct 16 01:01:57.033028 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 250/526] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:56 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:57.409356 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:57.409888 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:57.416818 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.417341 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.417781 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.418484 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.418946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.419377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.486921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:57.495083 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e8544b36-5623-4bfa-a560-c930f6d22dd3 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1623 microversion: 2.1 time: 0.090180 Oct 16 01:01:57.495877 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 277/527] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:57 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:57.744074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a60cb-38d8-43f6-beb8-8808ada4a1b9", "name": "network-vif-deleted", "tag": "09878dbb-7720-4ab8-8884-7c25165219b8"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:57.762507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.764911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.766182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.792553 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] Creating event network-vif-deleted:09878dbb-7720-4ab8-8884-7c25165219b8 for instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 on hv-cinder-maste Oct 16 01:01:57.800710 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-44bac0e2-b086-4f85-aedd-837c58650b14 req-8ba5c27c-80b3-4ec7-ba87-60d498c9af3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063369 Oct 16 01:01:57.802508 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 251/528] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:58.057116 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:58.057740 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:58.064529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.065267 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.066190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.067056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.067665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.068241 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.270354 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:58.279521 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8e1012b6-2717-405b-af91-8e9d13470eb8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.226540 Oct 16 01:01:58.280216 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 278/529] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:58 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:58.531319 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:58.533243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:58.544454 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.545585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.546028 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.546734 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.547187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.547637 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.585899 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.586390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.586823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.587280 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lazy-loading 'fault' on Instance uuid 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:58.638719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:58.648995 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ad95ef42-a6f2-4245-966f-f108c893337e tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 200 len: 1335 microversion: 2.1 time: 0.134394 Oct 16 01:01:58.649715 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 252/530] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:58 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:59.306701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:59.307700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:59.311638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:59.320727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.321588 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.322314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.323448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.324205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.325168 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.460774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:59.468702 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b33f7d65-77e0-4ef4-90d2-342fbefedd99 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.168649 Oct 16 01:01:59.469291 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 279/531] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:59 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:59.671922 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:59.672531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:59.679388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.679906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.680342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.681079 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.681530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.681951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.695675 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] HTTP exception thrown: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Request method failure captured: Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 HTTP/1.1 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1az5oSaOP7emFPSnqrD8Qd1eR4w_Tqq513Mv0EvXsbLF5G1I-f_hnNF51zFVaIHGgnlKweosha8QTEyQ9vAwZPh4oJm3x2t1QQkszzTTp61VvjSn_bc79PsTlJkS-JzTdnLQjZ-qqBov-bCdz21vap474ikSqvzL3pOfv9mfi2Aazc Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:01:59.697343 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_18cdea5418644c38bdff444de462b7c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/18cdea5418644c38bdff444de462b7c6"}]}] Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bb8be65b81ca4eee9a524ddb6577d188 Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. Oct 16 01:01:59.698822 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '0d8a60cb-38d8-43f6-beb8-8808ada4a1b9'} Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:59.699661 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. Oct 16 01:01:59.701088 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:01:59.702769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Returning 404 to user: Instance 0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:59.702769 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-48eff06f-a43b-47d4-8be4-cf591a53a8dd tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9" status: 404 len: 111 microversion: 2.1 time: 0.030783 Oct 16 01:01:59.702769 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 253/532] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:59 2022] GET /compute/v2.1/servers/0d8a60cb-38d8-43f6-beb8-8808ada4a1b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:59.709928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-324c8fe8-ab29-4e92-9a87-00f13fd27cb4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '.version_select at 0x7f5806f4c670>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:59.734560 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-324c8fe8-ab29-4e92-9a87-00f13fd27cb4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978205372" status: 202 len: 0 microversion: 2.1 time: 0.030928 Oct 16 01:01:59.735333 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 280/533] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 16 01:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978205372 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:59.821957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11074c3e-57cc-4f5b-8164-2fcc26b7c2f6", "tag": "9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:59.831363 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.831833 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.832298 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.843826 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] Creating event network-changed:9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad for instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 on hv-cinder-maste Oct 16 01:01:59.849742 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-938a8afa-1f8a-4d99-be12-abf06318fc3c req-5a541e2d-d137-43f7-a57d-a5b39d9c8859 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 Oct 16 01:01:59.850493 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 254/534] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:00.496466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:00.497576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:00.507423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:00.508054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:00.508805 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.509946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:00.510700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:00.511403 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.656619 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.667274 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c9fcb2cb-d9f6-4882-8e9b-43502c46b55e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.178186 Oct 16 01:02:00.667762 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 281/535] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:00 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:01.691712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:01.692473 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:01.699114 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.699596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.700118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.700966 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.701551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.701957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.836105 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:01.844220 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b88bee39-87fb-4d0f-91cd-503c798d3341 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.156729 Oct 16 01:02:01.846045 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 255/536] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:01 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:02.628279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.628796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.635162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.635647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.636077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.636762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.637259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.637680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.662410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:02:02.744180 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a5306d60-d968-4974-9d3a-83b52d3b15f8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 204 len: 0 microversion: 2.1 time: 0.119247 Oct 16 01:02:02.744973 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 282/537] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:02 2022] DELETE /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:02.753175 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.753781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.760714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.761226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.761662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.762349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.762801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.763218 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.869195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.870238 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.876328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.876925 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.877436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.878217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.878836 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.879324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.896100 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:02.904103 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-65e21eac-eabc-4b48-ba89-3cb97a577a60 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1508 microversion: 2.1 time: 0.154836 Oct 16 01:02:02.904682 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 256/538] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:02 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:03.013759 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.021909 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-26136179-3504-47eb-a7b4-6424d58cb342 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.156893 Oct 16 01:02:03.022485 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 283/539] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:02 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:03.927889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:03.928527 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:03.935791 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.936271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.936851 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.937553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.937994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.938425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.053848 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:04.054746 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:04.061823 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.062421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.062927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.063735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.064262 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.064766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.090504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:04.099040 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b0ff0134-4485-4c63-b8d6-dfd1e187d9a5 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1508 microversion: 2.1 time: 0.175084 Oct 16 01:02:04.100192 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 257/540] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:03 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:04.210126 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:04.222822 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-df403bb0-9a6a-464b-9830-2471ceb08754 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.173397 Oct 16 01:02:04.223656 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 284/541] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:04 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:05.064005 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b5d739-45c6-406a-a9e6-3f9907102a15", "name": "network-vif-deleted", "tag": "35acdc7e-ec4e-4155-8024-e8e4f947291d"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:05.069202 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:05.077060 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.077723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.079467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.095187 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] Creating event network-vif-deleted:35acdc7e-ec4e-4155-8024-e8e4f947291d for instance 70b5d739-45c6-406a-a9e6-3f9907102a15 on hv-cinder-maste Oct 16 01:02:05.100739 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-575a931d-74a0-4fd2-90f4-71dd90b86b74 req-82db04cd-4868-40b8-81d1-3c12069bcde1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039982 Oct 16 01:02:05.101584 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 258/542] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:05.123156 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:05.123770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:05.125804 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:05.126490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=10 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:05.132917 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.133429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.133902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.134604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.135141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.135480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.200002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:05.203796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:05.209201 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a7871ce4-7fc3-4691-8dbb-aa015a3e1232 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 200 len: 1292 microversion: 2.1 time: 0.090076 Oct 16 01:02:05.210038 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 285/543] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:05 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:05.250034 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:05.250860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:05.257357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.258537 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.259141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.259840 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.260291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.260707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.403951 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:05.413602 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-309fdadb-0059-434a-902a-79618f5c44a1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.167857 Oct 16 01:02:05.414162 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 259/544] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:05 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:05.952322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11074c3e-57cc-4f5b-8164-2fcc26b7c2f6", "name": "network-vif-plugged", "status": "completed", "tag": "9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:05.963356 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.963829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.964284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.975788 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] Creating event network-vif-plugged:9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad for instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 on hv-cinder-maste Oct 16 01:02:05.980621 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-885ef8f2-b543-4ce0-b9cb-bb45d70d6689 req-89f2a839-060c-4d89-a261-1f5fc39a39e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088719 Oct 16 01:02:05.981260 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 286/545] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:06.232038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.232696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: 70b5d739-45c6-406a-a9e6-3f9907102a15] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.239667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.240137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.240579 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.241301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.241757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.242169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.255673 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] HTTP exception thrown: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Request method failure captured: Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 HTTP/1.1 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1az5oSaOP7emFPSnqrD8Qd1eR4w_Tqq513Mv0EvXsbLF5G1I-f_hnNF51zFVaIHGgnlKweosha8QTEyQ9vAwZPh4oJm3x2t1QQkszzTTp61VvjSn_bc79PsTlJkS-JzTdnLQjZ-qqBov-bCdz21vap474ikSqvzL3pOfv9mfi2Aazc Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:02:06.257409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_18cdea5418644c38bdff444de462b7c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/18cdea5418644c38bdff444de462b7c6"}]}] Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bb8be65b81ca4eee9a524ddb6577d188 Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. Oct 16 01:02:06.259050 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '70b5d739-45c6-406a-a9e6-3f9907102a15'} Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:06.262918 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. Oct 16 01:02:06.264343 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:06.265633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Returning 404 to user: Instance 70b5d739-45c6-406a-a9e6-3f9907102a15 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:06.265633 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-66bc9168-7df6-4d5b-a9c5-f53a9b77d9b6 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15" status: 404 len: 111 microversion: 2.1 time: 0.030756 Oct 16 01:02:06.265633 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 260/546] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/70b5d739-45c6-406a-a9e6-3f9907102a15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:06.268990 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.269686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.276379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.276905 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.277401 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.278111 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.278600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.279029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.304244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:02:06.385994 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-71db6645-fc35-415e-b1c2-4b58528b8f5c tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 204 len: 0 microversion: 2.1 time: 0.121666 Oct 16 01:02:06.386581 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 287/547] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:06 2022] DELETE /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:06.394872 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.395483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.401683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.402157 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.402585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.403260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.403718 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.404131 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.436780 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.437517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.443607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.444094 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.444529 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.445250 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.445706 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.446130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.586491 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:06.594505 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f32a6836-125f-40e8-b688-01d63a9d95fe tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.203487 Oct 16 01:02:06.595168 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 261/548] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:06.613422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:06.624694 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a0a32c07-2397-414b-86ab-3f1738a3d29e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.192064 Oct 16 01:02:06.625582 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 288/549] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:07.622242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:07.623231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:07.626580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:07.632267 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.632768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.633251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.633972 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.634450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.634883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.640183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=100 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:07.648221 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:07.648866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:07.655975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.656572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.657123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.657826 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.658284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.658713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.833850 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:07.837043 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:07.841946 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-78600087-779b-44d9-9503-ab52aa226ba8 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.226158 Oct 16 01:02:07.842519 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 262/550] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:07 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:07.845356 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b8c9583e-f115-4d4d-8d87-1454bf6e6644 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.201184 Oct 16 01:02:07.845898 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 289/551] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:07 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:08.867776 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:08.868493 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:08.869877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:08.870578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:08.877198 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.877768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.878273 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.878438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.878909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.879086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.879417 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.879575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.880072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.880249 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.880731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.881301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.073545 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.076873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.081906 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-dd250bf3-1679-4a07-ac20-9e125646e457 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1522 microversion: 2.1 time: 0.218820 Oct 16 01:02:09.082834 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 263/552] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:08 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:09.090528 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1e14f0e6-ae65-4ea0-8767-00facd3c9a1d tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1360 microversion: 2.1 time: 0.225235 Oct 16 01:02:09.091107 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 290/553] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:08 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:10.015371 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34fac95-f3ff-47f0-b784-01e96481a86b", "name": "network-vif-deleted", "tag": "bbd562e2-b40f-4d38-9d0e-61a02f4c454b"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:10.025241 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.025723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.026153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.037174 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] Creating event network-vif-deleted:bbd562e2-b40f-4d38-9d0e-61a02f4c454b for instance f34fac95-f3ff-47f0-b784-01e96481a86b on hv-cinder-maste Oct 16 01:02:10.042126 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-d9ae7cae-7b20-41bf-9b02-a43f2cb43a27 req-e16455de-3f32-4159-9594-04dc16e67d37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Oct 16 01:02:10.042709 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 264/554] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:10.105637 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.106221 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.114163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.114674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.114974 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.115109 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.115694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.115819 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.116933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.116933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.122770 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.123554 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.124064 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.124781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.125364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.125798 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.193439 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8be65b81ca4eee9a524ddb6577d188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cdea5418644c38bdff444de462b7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:10.201793 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b4148d6e-e398-40f3-867d-2d92d88b28d4 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 200 len: 1480 microversion: 2.1 time: 0.099999 Oct 16 01:02:10.202418 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 291/555] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 1480 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:10.285624 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:10.293913 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-bdf0d895-5afc-47ed-b1af-358948975608 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1547 microversion: 2.1 time: 0.183880 Oct 16 01:02:10.294482 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 265/556] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:10.316956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.317755 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.324810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.325541 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.326059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.326906 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.327352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.327766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.407884 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d5da246f-6aa9-4279-a660-0fa6ed6516c1 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095025 Oct 16 01:02:10.408672 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 292/557] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:11.226255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:11.226890 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] [instance: f34fac95-f3ff-47f0-b784-01e96481a86b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:11.234050 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.234597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.235036 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.235796 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.236255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.236683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.250909 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] HTTP exception thrown: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Request method failure captured: Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b HTTP/1.1 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1az5oSaOP7emFPSnqrD8Qd1eR4w_Tqq513Mv0EvXsbLF5G1I-f_hnNF51zFVaIHGgnlKweosha8QTEyQ9vAwZPh4oJm3x2t1QQkszzTTp61VvjSn_bc79PsTlJkS-JzTdnLQjZ-qqBov-bCdz21vap474ikSqvzL3pOfv9mfi2Aazc Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:02:11.252579 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_18cdea5418644c38bdff444de462b7c6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/18cdea5418644c38bdff444de462b7c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/18cdea5418644c38bdff444de462b7c6"}]}] Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 18cdea5418644c38bdff444de462b7c6 Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-607840306 Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bb8be65b81ca4eee9a524ddb6577d188 Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-607840306-project Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. Oct 16 01:02:11.253939 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'f34fac95-f3ff-47f0-b784-01e96481a86b'} Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:11.254649 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. Oct 16 01:02:11.255751 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:02:11.256793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] Returning 404 to user: Instance f34fac95-f3ff-47f0-b784-01e96481a86b could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:11.256793 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3628c60f-0153-4a65-a412-559b2e398167 tempest-ServerRescueNegativeTestJSON-607840306 tempest-ServerRescueNegativeTestJSON-607840306-project] 10.222.0.13 "GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b" status: 404 len: 111 microversion: 2.1 time: 0.032135 Oct 16 01:02:11.256793 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 266/558] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:11 2022] GET /compute/v2.1/servers/f34fac95-f3ff-47f0-b784-01e96481a86b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:11.606118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11074c3e-57cc-4f5b-8164-2fcc26b7c2f6", "tag": "9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:11.616197 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.616690 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.617162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.629801 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] Creating event network-changed:9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad for instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 on hv-cinder-maste Oct 16 01:02:11.638387 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-763c0d50-90f1-4d14-93dc-f90d3d819aa3 req-1728617c-733f-4310-b854-9d7b455f2cc3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093446 Oct 16 01:02:11.639221 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 293/559] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:44.866479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:44.867139 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:44.869354 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=9 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.870017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=20 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:44.876303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.876782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.877240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.877919 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.878364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.878783 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.905247 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-553a8e0b-03f5-4a14-9244-359cd59fe94f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/ips" status: 200 len: 151 microversion: 2.20 time: 0.042650 Oct 16 01:02:44.905985 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 267/560] 10.222.0.13 () {60 vars in 1289 bytes} [Sun Oct 16 01:02:44 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:02:46.775157 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:46.776099 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:46.782670 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:46.783292 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:46.791608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.792094 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.792530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.793399 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.793857 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.794293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.819277 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lazy-loading 'flavor' on Instance uuid f008e5f6-0855-4cea-8f0f-54fc18179687 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:47.016209 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c31dead1-e6e0-42bf-8005-3403fa567589 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/action" status: 202 len: 0 microversion: 2.20 time: 0.244053 Oct 16 01:02:47.016807 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 294/561] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 16 01:02:46 2022] POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:47.025138 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:47.025871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:47.032363 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.032876 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.033327 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.034016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.034468 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.034888 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.170222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:47.178771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:47.180284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:47.181968 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0488ff86-2db8-4036-a751-d2eda8cb5195 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.160826 Oct 16 01:02:47.182602 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 268/562] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:47 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:48.208727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:48.209471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:48.216779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.217315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.217751 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.218439 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.218895 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.219328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.358440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.367183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.368630 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.369812 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3514df42-296b-49bc-86a8-1508dcaef3d7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.165917 Oct 16 01:02:48.370379 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 295/563] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:48 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:49.397891 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:49.398670 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:49.407428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.408060 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.408624 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.409552 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.410148 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.410701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.542049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:49.550324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:49.551735 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:49.553007 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-15d3fbdd-0cea-4b7c-a20a-97fa588518c9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.160383 Oct 16 01:02:49.553555 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 269/564] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:49 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:50.579178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.579816 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:50.586551 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.587047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.587478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.588175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.588632 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.589092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.720166 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.728724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.730204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.731399 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a7303e1a-5cdc-4274-8a97-377d78d0cb97 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.156261 Oct 16 01:02:50.731958 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 296/565] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:51.757251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:51.757881 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:51.764299 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.764785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.765227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.765910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.766359 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.766799 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.904450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:51.911989 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:51.913754 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:51.914951 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6600c792-82ba-4515-966f-35303f0a9b9f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.161580 Oct 16 01:02:51.915493 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 270/566] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:51 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:52.939880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:52.940494 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:52.947251 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:52.948254 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:52.948700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:52.949427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:52.949887 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:52.950312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.085554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.095839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.097674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.098858 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4b114bce-0b96-4c4c-aac0-ff4df588d6f6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.163031 Oct 16 01:02:53.099395 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 297/567] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:52 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:54.123757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:54.124377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:54.130934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:54.131418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:54.131847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:54.132532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:54.133011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:54.133431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:54.262694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:54.271111 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:54.272556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:54.273755 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d04bb9f1-447a-4b97-94bb-eb21698306e6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.154102 Oct 16 01:02:54.274312 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 271/568] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:54 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:55.298654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:55.299232 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:55.305827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:55.306294 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:55.306741 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:55.307414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:55.307855 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:55.308269 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:55.437525 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:55.445524 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:55.446951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:55.448105 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-33a15387-761f-45cc-8f2c-e237471a8612 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.153399 Oct 16 01:02:55.448660 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 298/569] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:55 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:56.474682 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:56.475292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:56.481586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.482073 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.482504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:56.483193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.483650 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.484067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:56.616687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:56.625086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:56.626529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:56.627673 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d558388f-0802-4a60-8fd0-082b25e7c556 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.157454 Oct 16 01:02:56.628221 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 272/570] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:56 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:57.653505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:57.654361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:57.660973 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:57.661556 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:57.661990 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:57.662682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:57.663141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:57.663564 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:57.791570 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:57.800001 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:57.801843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:57.803121 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a212ce3f-bad0-4982-b78f-e97aaf59dec1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.154225 Oct 16 01:02:57.803781 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 299/571] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:57 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:58.828533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:58.829201 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:58.835465 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.836104 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.836680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.837544 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.838141 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.838723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.977729 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:58.986249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:58.987671 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:58.988851 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2f844ca5-ef75-4e40-a1a1-3a2dbde99906 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.165200 Oct 16 01:02:58.989414 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 273/572] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:58 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:00.013940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:00.014538 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:00.021348 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.021770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.022199 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.022909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.023357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.023809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.158083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.166353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.167809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.168992 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f08a4ef0-57f9-400e-b89f-23d62c785efb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.159044 Oct 16 01:03:00.169666 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 300/573] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:00 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:01.196467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:01.197225 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:01.205838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.206319 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.206747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.207439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.207893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.208299 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.344329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.356825 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.359049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.360575 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-028071ef-de3d-4891-845a-efa1fc54622d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.169720 Oct 16 01:03:01.361131 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 274/574] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:01 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:02.385572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:02.386166 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:02.392599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.393124 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.393565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.394272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.394745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.395171 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.534514 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:02.543007 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:02.544564 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:02.546037 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4cd42181-c5bf-453f-8b88-88e5c99be7c3 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.164583 Oct 16 01:03:02.546571 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 301/575] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:02 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:03.570705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.571389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:03.578967 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.579470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.579966 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.580697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.581203 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.581623 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.716040 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.727515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.729715 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.731640 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e98bf1dc-aab7-4226-8972-319c33689802 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.164726 Oct 16 01:03:03.732460 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 275/576] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:04.760036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:04.760722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:04.769886 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.770532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.771106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.772022 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.772628 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.773236 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.912019 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:04.923507 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:04.924977 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:04.926650 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-490dd4ce-8f80-4cb7-b858-62d81285f522 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.172120 Oct 16 01:03:04.927182 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 302/577] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:04 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:05.952002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.952545 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:05.960130 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.960605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.961929 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.962968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.963421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.963802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.101140 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:06.110357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:06.112219 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:06.113571 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-841f6dd7-74ed-4916-adb7-1cbcb4040986 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.165559 Oct 16 01:03:06.114205 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 276/578] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:07.139172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.139887 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:07.146876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.147361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.147789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.148478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.148979 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.149395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.284299 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.293765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.295229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.296410 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2bee3b2c-538c-43fc-a5be-9d3894df0a49 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.161240 Oct 16 01:03:07.299453 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 303/579] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:08.318701 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "name": "network-vif-plugged", "status": "completed", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:08.342622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.344064 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.344482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.353247 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.354386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.357460 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] Creating event network-vif-plugged:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:03:08.361788 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.362502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.363211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.364174 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.364704 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.365312 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-a0e1c4b1-3ae2-404e-8598-e3aef5d4291c req-5d3d5ace-287a-4b9d-bba4-942f4c8aa155 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056495 Oct 16 01:03:08.365440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.366377 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 304/580] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:08.373480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.374323 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.383300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.383788 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.384461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.385927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.386517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.386762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.400947 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-68559d50-305d-42db-86f8-a43a15d07a0e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/ips" status: 200 len: 150 microversion: 2.1 time: 0.233228 Oct 16 01:03:08.401511 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 277/581] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/ips => generated 150 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:08.520931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.529377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.531272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.532631 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f9cf5afe-957f-4be8-a0c0-320966bdc118 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.164927 Oct 16 01:03:08.533344 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 305/582] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:09.559144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:09.559732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:09.566651 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.567132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.567570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.568295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.568778 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.569264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.700200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:09.708859 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:09.710407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:09.711592 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-280c86b8-4374-4d2e-96ed-c9ff1174869f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.156734 Oct 16 01:03:09.712139 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 278/583] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:09 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:09.746830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27057e0d-85cd-4c11-8ebd-6aa908276e0d"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:09.749451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:09.756243 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.756723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.757186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.757863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.758315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.758732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.047799 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a89683d1-30e7-4a76-9739-b9fa18c4f581 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304761 Oct 16 01:03:10.048409 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 306/584] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:03:09 2022] POST /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:10.741843 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.742705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.752209 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.752695 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.753157 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.753851 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.754302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.754733 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.888593 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.897144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.898592 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.899744 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0f309ce6-e36f-4225-8376-145554e7c425 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1744 microversion: 2.20 time: 0.164690 Oct 16 01:03:10.900309 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 279/585] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:11.926044 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:11.926726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:11.933716 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.934202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.934636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.935318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.935761 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.936175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.065873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.069852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:12.076086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.077774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.078978 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9dbc5b1b-1cb7-435e-b37b-e155f402962e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.157344 Oct 16 01:03:12.079552 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 307/586] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:11 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:12.303065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27057e0d-85cd-4c11-8ebd-6aa908276e0d"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:12.305691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.312359 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.312869 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.313293 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.314079 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.314577 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.315003 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.394246 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: POST /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments HTTP/1.1 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 74 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:03:12.395841 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: {"volumeAttachment": {"volumeId": "27057e0d-85cd-4c11-8ebd-6aa908276e0d"}} Oct 16 01:03:12.397484 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'server_id': 'ffecdc47-2f1e-48ca-a824-f5a3be48730d', 'body': {'volumeAttachment': {'volumeId': '27057e0d-85cd-4c11-8ebd-6aa908276e0d'}}} Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:03:12.398394 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:12.399729 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 400 to user: Invalid volume: volume 27057e0d-85cd-4c11-8ebd-6aa908276e0d is already attached to instances: ffecdc47-2f1e-48ca-a824-f5a3be48730d {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9c22d3aa-9a49-4288-bf74-5abafb1a707f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098289 Oct 16 01:03:12.401114 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 280/587] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:03:12 2022] POST /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:03:12.463017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.463548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.471837 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.472288 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.472722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.473447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.474064 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.474641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.560116 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'services' on Instance uuid ffecdc47-2f1e-48ca-a824-f5a3be48730d {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:12.657031 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2cfe8dfa-16bb-4f80-81b2-b9a051f6663b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments/27057e0d-85cd-4c11-8ebd-6aa908276e0d" status: 202 len: 0 microversion: 2.1 time: 0.197599 Oct 16 01:03:12.657754 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 308/588] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:03:12 2022] DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments/27057e0d-85cd-4c11-8ebd-6aa908276e0d => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:12.672313 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.674838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.686198 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.686771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.687392 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.688120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.688575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.689037 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.725274 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b70fd212-caf3-4230-9798-9fdde46927f2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062979 Oct 16 01:03:12.725831 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 281/589] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:13.106409 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.107266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.114276 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.114995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.115668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.116575 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.117286 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.117939 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.265324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:13.273478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:13.274910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:13.276063 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b3870608-c955-4e00-847c-53d8c20428ea tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.174751 Oct 16 01:03:13.276632 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 309/590] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:13.738644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.741188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.748961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.749892 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.750887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.751837 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.752520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.753337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.787953 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-037068eb-6951-4fbb-aa68-823f07586aee tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053451 Oct 16 01:03:13.788960 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 282/591] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.302896 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.303507 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:14.310073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.310512 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.311141 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.312181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.312787 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.313502 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.447909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.456496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.457985 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.459153 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5a1ac7fc-4424-46f0-9ed9-5f33c2645904 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.160251 Oct 16 01:03:14.459716 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 310/592] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:14.801963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.804603 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:14.814702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.815470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.816156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.817223 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.817747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.818366 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.849763 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-425cbf47-3b2d-4e89-ac61-b2d1dbb63e44 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052500 Oct 16 01:03:14.850317 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 283/593] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:14.921357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.921964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:14.928144 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.928647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.929102 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.929834 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.930285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.930711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.958653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:03:15.041986 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1f0952c9-68b8-40c6-a1d4-d3e08a1faf5f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 204 len: 0 microversion: 2.1 time: 0.124894 Oct 16 01:03:15.042824 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 311/594] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:14 2022] DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:03:15.054261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.054956 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.056900 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=35 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:15.062296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.062776 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.063210 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.063896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.064347 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.064768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.068780 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=99 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:15.210920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.220016 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9554223a-84a4-47fa-b88b-00197202aa6a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1680 microversion: 2.1 time: 0.170522 Oct 16 01:03:15.220580 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 284/595] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:15.486000 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.486596 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.493386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.493849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.494261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.495303 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.495832 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.496477 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.640369 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.649327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.650947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.652161 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-41228778-64cf-44bf-96d6-2fb5449d5652 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.170659 Oct 16 01:03:15.652753 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 312/596] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:16.251515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.252220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.259158 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.259658 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.260086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.260758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.261497 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.261916 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.405732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.413964 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-24e75e0e-659b-4300-97a6-a790c4e15956 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1680 microversion: 2.1 time: 0.166575 Oct 16 01:03:16.414742 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 285/597] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:16.678164 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.678723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.685368 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.686043 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.686634 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.687580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.688227 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.688659 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.841130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.853825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.864775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.866366 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0d1ce62d-f88a-4943-ab0d-933155f883b5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.192282 Oct 16 01:03:16.867549 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 313/598] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:17.439863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:17.440404 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:17.447961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.449582 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.450096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.450884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.451342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.451756 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.594832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:17.605341 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2ebf6a14-7215-4c15-adf4-c5253570e1b6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1680 microversion: 2.1 time: 0.170388 Oct 16 01:03:17.606172 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 286/599] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:17 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:17.891729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:17.892330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:17.894839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:17.900282 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.900765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.901217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.901910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.902356 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.902768 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.044355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:18.053259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:18.054691 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:18.055849 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e8db6308-2d6a-4ec7-a44f-7b7668a3fc96 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.168144 Oct 16 01:03:18.069285 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 314/600] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:17 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:18.411367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffecdc47-2f1e-48ca-a824-f5a3be48730d", "name": "network-vif-deleted", "tag": "e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:18.436994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.437705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.438278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.455050 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] Creating event network-vif-deleted:e9e3f4fa-8418-4f0d-bb04-1a34baa4cc17 for instance ffecdc47-2f1e-48ca-a824-f5a3be48730d on hv-cinder-maste Oct 16 01:03:18.465770 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-38ebccac-d223-482c-8a68-551d84bf3869 req-40b4574a-6b0e-452f-a63c-add563a41a51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057559 Oct 16 01:03:18.466780 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 287/601] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:18.628453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:18.629333 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:18.640614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.641388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.642763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.644490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.645392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.647846 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.723603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.727700 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.728561 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.732580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'fault' on Instance uuid ffecdc47-2f1e-48ca-a824-f5a3be48730d {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:18.780603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:18.789809 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fd9f7efd-4fb4-46a9-a843-3dae36ad31c0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 200 len: 1330 microversion: 2.1 time: 0.165690 Oct 16 01:03:18.790729 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 315/602] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:18 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 1330 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:19.085157 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:19.085993 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:19.093300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.093860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.094564 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.096249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.097033 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.118533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.355810 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.366039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.370511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.372180 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-83ae4436-877b-4211-a200-3fb517d01d5b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.293836 Oct 16 01:03:19.374000 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 288/603] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:19 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:19.816014 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:19.816785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:19.826569 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.827291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.827805 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.828574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.829115 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.829765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.845312 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d HTTP/1.1 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:03:19.849234 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:03:19.850659 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'ffecdc47-2f1e-48ca-a824-f5a3be48730d'} Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:19.851402 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:03:19.853281 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:03:19.854615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:19.854615 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9f060b83-48a2-4701-8aee-794b7225bbc2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 404 len: 111 microversion: 2.1 time: 0.041380 Oct 16 01:03:19.854615 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 316/604] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:19 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:03:19.863572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-209dab49-93c7-4390-983b-f5640ff1d75f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '.version_select at 0x7f5806f7eee0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:19.891006 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-209dab49-93c7-4390-983b-f5640ff1d75f tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75206919" status: 202 len: 0 microversion: 2.1 time: 0.034239 Oct 16 01:03:19.891588 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 289/605] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 16 01:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75206919 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:20.414161 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:20.417825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:20.424530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.425063 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.425503 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.426207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.426839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.427270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.606319 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:20.616036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:20.622248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:20.623695 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0286867a-1e0b-4b06-8878-3e9e12d01f35 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.217998 Oct 16 01:03:20.625185 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 317/606] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:20 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:20.695839 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a04ab396-1b43-4225-928c-c48b0123ea63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: .version_select at 0x7f5806ed41f0>, body: {"keypair": {"name": "tempest-keypair-152628030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb8YLL27c1vGGRDamATgmdUC9vIi+V5kBHaSXlzsGHtBIIDn3KvMUrqfGs6G2HrJ5/wqnF5uO9Rhk2cIklMKfrAInhE0y+xWTesyeAVmIwGDnsDJZL/U8qxdrGdeZ8S8w=="}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:20.717343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-a04ab396-1b43-4225-928c-c48b0123ea63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:20.721714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-a04ab396-1b43-4225-928c-c48b0123ea63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'key_pairs'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:20.754690 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a04ab396-1b43-4225-928c-c48b0123ea63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062697 Oct 16 01:03:20.755307 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 290/607] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 01:03:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:21.651282 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:21.651680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:21.659358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.659849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.660705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.663010 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.663765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.664402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.892331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:21.900576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:21.902150 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:21.903252 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8bbb3be3-f6db-45b9-96dd-1856b54af3ff tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.256435 Oct 16 01:03:21.903846 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 318/608] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:21 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:22.159375 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-633579552", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3913489d-de8f-457c-b3d2-8d2ca6fdbe30"}], "security_groups": [{"name": "tempest-securitygroup--1088348965"}], "key_name": "tempest-keypair-152628030", "user_data": "}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:22.274557 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] validate_networks() for [('3913489d-de8f-457c-b3d2-8d2ca6fdbe30', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:22.929480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:22.930333 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:22.943240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:22.945273 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:22.947893 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:22.949580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:22.950071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:22.950742 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.192156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:23.193151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:23.193959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:23.194435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:23.194803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.194927 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:23.205109 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.207310 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.208636 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3d405119-0961-4754-b73c-6070cdb67b75 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.283311 Oct 16 01:03:23.209660 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 319/609] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:22 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:23.237240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.238422 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.239063 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.240546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.241973 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.243492 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.267943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:23.273889 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Getting quotas for user 2da699bb0c51440593b8175d05869203 and project 94363b1b0a0d48229b3bef2b1b779d2e. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:23.286372 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:23.288985 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:23.337788 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3a9093a5-a03a-471c-987b-e9de7d105f63 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.183428 Oct 16 01:03:23.339195 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 291/610] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:03:23.351233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-05132ae4-4b64-4bb6-a382-0a024b786b1e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:23.351848 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-05132ae4-4b64-4bb6-a382-0a024b786b1e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:23.422159 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-05132ae4-4b64-4bb6-a382-0a024b786b1e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.429784 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-05132ae4-4b64-4bb6-a382-0a024b786b1e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1240 microversion: 2.1 time: 0.082675 Oct 16 01:03:23.440895 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 320/611] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:23 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:24.238907 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:24.239511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:24.245961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.246438 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.247061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.247933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.248380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.248986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.402147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:24.410755 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:24.412584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:24.413998 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1c033c8a-2dcd-4858-a50a-b72a7463d4fd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.179626 Oct 16 01:03:24.414996 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 292/612] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:24 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:24.454932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:24.455648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:24.474612 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.474975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.475590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.476231 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.476861 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.477568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.565778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:24.576580 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b44c0bfb-e226-4f3c-8d97-76ace4957718 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1292 microversion: 2.1 time: 0.126537 Oct 16 01:03:24.578558 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 321/613] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:24 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:25.439590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:25.440400 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:25.447266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.447748 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.448245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.448961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.449413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.449830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.582323 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.590572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.592012 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.593415 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ebbda6b1-35c3-4b8b-863b-2a944489c1fa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1739 microversion: 2.20 time: 0.157769 Oct 16 01:03:25.593966 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 293/614] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:25 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:25.610839 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:25.612259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:25.619183 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.619740 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.620271 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.621113 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.621785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.622289 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.773030 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.784889 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1e76e2e2-77f3-4be5-b132-d89c22ebb579 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.178487 Oct 16 01:03:25.786252 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 322/615] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:25 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:26.431376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee3d0df-6e99-43f2-91f7-eaf717c48f37", "tag": "6e027178-56fc-448f-a03c-fa36b8b606db"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:26.441507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.442161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.443226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.456245 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] Creating event network-changed:6e027178-56fc-448f-a03c-fa36b8b606db for instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 on hv-cinder-maste Oct 16 01:03:26.461574 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-ac1ab6d4-b1f4-4819-8bdb-ea795ff48141 req-f888b13e-0bd3-4ed6-a1d9-b96937d186ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Oct 16 01:03:26.462329 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 294/616] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:26.619931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:26.620569 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:26.627293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.627778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.628213 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.628927 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.629384 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.629826 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.647777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:26.759768 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:26.768526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:26.770139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:26.771266 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6a739652-7e48-4cf0-aef2-9297ed1d58b6 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1721 microversion: 2.20 time: 0.155339 Oct 16 01:03:26.771893 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 323/617] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:26 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:26.811919 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:26.812620 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:26.818968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.819450 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.819879 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.820570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.821049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.821467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.954918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:26.963076 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4821e804-aa4a-421f-8776-b6b5c6c9d2a0 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.155602 Oct 16 01:03:26.963644 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 295/618] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:26 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:27.800898 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:27.801831 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:27.812351 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:27.812830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:27.813293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:27.813972 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:27.814423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:27.814840 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:27.944761 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:27.953011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:27.954440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:27.955585 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fc066c10-d7a7-4e28-be4d-be23d624a844 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1721 microversion: 2.20 time: 0.161356 Oct 16 01:03:27.956143 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 324/619] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:27 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:27.986426 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:27.987030 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:27.993714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:27.994192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:27.994625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:27.995309 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:27.995743 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:27.996183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.127205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:28.135300 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f44d9f46-46b9-4435-bbd4-2065a71b725a tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.152694 Oct 16 01:03:28.135864 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 296/620] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:27 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:28.988278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:28.988909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:28.996826 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:28.997439 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:28.997942 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.998748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:28.999315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:28.999816 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.140649 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.149301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.150744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.151904 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d0db92bf-40f8-4f3f-bab0-f4be64a5268b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1721 microversion: 2.20 time: 0.168712 Oct 16 01:03:29.152465 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 325/621] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:28 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:29.158388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:29.159002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:29.165496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.165980 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.166415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.167229 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.167691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.168114 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.305243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.313528 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e412cc24-601d-46f2-b5c9-9ebfb166cdfc tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.159106 Oct 16 01:03:29.314165 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 297/622] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:29 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:30.180598 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:30.181656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:30.190375 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.190868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.191308 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.192003 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.192459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.192883 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.324502 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:30.333023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:30.334480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:30.335647 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d7b9a56c-aa03-48b4-9bfd-d47cb3dd5d15 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1721 microversion: 2.20 time: 0.161775 Oct 16 01:03:30.336223 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 326/623] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:30 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:30.346389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:30.346389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:30.346389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.346389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.347042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.347042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.347042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.347278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.485678 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "name": "network-vif-unplugged", "status": "completed", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:30.500325 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:30.501800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.502774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.503217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.516589 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-86cc2978-61ad-43e4-b739-9ad81551646c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.182688 Oct 16 01:03:30.518213 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] Creating event network-vif-unplugged:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:03:30.525161 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-86f25c89-e217-42c5-9100-cb344dda39f2 req-7f640ecf-3b6e-407a-8028-bd40f7cabc0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043306 Oct 16 01:03:30.525852 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 327/624] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:30.531505 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 298/625] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:30 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:31.362687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:31.364311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:31.372673 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.373336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.373881 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.374702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.375403 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.376309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.529938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.538374 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.539908 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:31.540355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.540910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:31.541261 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bf29af2c-1cc4-4c45-8114-7e2eb27a5839 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1724 microversion: 2.20 time: 0.183779 Oct 16 01:03:31.542209 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 328/626] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:31 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:31.548210 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.548723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.549192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.549968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.550439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.551260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.567055 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e857753-6a61-4868-982a-eb82cb41bfb3"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:31.569665 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:31.575467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.575954 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.576395 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.577155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.577617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.578038 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.728903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.738557 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-94df3f25-0ee6-4072-b677-9fb65f8af396 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.202382 Oct 16 01:03:31.739564 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 299/627] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:31 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:31.928774 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1ca64ace-6075-43c2-a186-f4ec13d7e757 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.365850 Oct 16 01:03:31.929418 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 329/628] 10.222.0.13 () {62 vars in 1364 bytes} [Sun Oct 16 01:03:31 2022] POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:32.062067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:32.062767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:32.069532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.070013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.070460 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.071170 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.071615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.072034 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.354545 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-20ad2855-b5fa-4f60-b9a7-91ec8dc0698e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments/4e857753-6a61-4868-982a-eb82cb41bfb3" status: 202 len: 0 microversion: 2.20 time: 0.296468 Oct 16 01:03:32.355160 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 300/629] 10.222.0.13 () {60 vars in 1457 bytes} [Sun Oct 16 01:03:32 2022] DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments/4e857753-6a61-4868-982a-eb82cb41bfb3 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:03:32.421737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:32.422580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:32.430211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.430692 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.431120 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.431808 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.432307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.432730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.477259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118977) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:03:32.548019 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1984f7b9-adba-4d21-952c-d4f0eab75b41 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/action" status: 202 len: 0 microversion: 2.20 time: 0.130795 Oct 16 01:03:32.549057 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 330/630] 10.222.0.13 () {62 vars in 1319 bytes} [Sun Oct 16 01:03:32 2022] POST /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:03:32.557320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:32.558460 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:32.558872 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee3d0df-6e99-43f2-91f7-eaf717c48f37", "name": "network-vif-plugged", "status": "completed", "tag": "6e027178-56fc-448f-a03c-fa36b8b606db"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:32.566265 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.566749 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.567362 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.568240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.568454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.568710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.568963 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.569163 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.569596 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.583704 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] Creating event network-vif-plugged:6e027178-56fc-448f-a03c-fa36b8b606db for instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 on hv-cinder-maste Oct 16 01:03:32.588793 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-056e12df-bb56-4b2e-b29a-e54429505701 req-2f2b041a-dbdb-479f-9acb-78906bd30428 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Oct 16 01:03:32.589914 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 331/631] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:32.710904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:32.720030 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:32.721997 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:32.723371 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9936f8d8-a1fb-418a-b6b8-c1d16db4305b tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1672 microversion: 2.20 time: 0.170188 Oct 16 01:03:32.723971 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 301/632] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:32 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:32.761515 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:32.762211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:32.769598 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.770078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.770505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.771211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.771624 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.772226 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.913711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:32.921719 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9bdcaaa6-49dc-429a-ad85-58a5c52cc336 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.164458 Oct 16 01:03:32.922282 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 332/633] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:32 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:33.751549 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:33.752186 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:33.754300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.754945 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=10 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.761323 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.761807 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.762246 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.762940 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.763394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.763844 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.767885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.898625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.907047 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.908533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.909716 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a2638ff2-c02c-4ac4-8b9d-0a48392e01ba tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1672 microversion: 2.20 time: 0.162494 Oct 16 01:03:33.910312 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 302/634] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:33 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:33.945262 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:33.945873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:33.948311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:33.954178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.954662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.955090 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.955775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.956224 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.956640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.100702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:34.108748 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-845adf01-5313-4a77-99d1-e5b1a0835747 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1366 microversion: 2.1 time: 0.167697 Oct 16 01:03:34.109364 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 333/635] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:33 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:34.936468 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:34.937115 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:34.944351 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.944866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.945301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.945991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.946444 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.946865 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.077338 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.086291 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.087724 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.088908 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-42858839-9718-440a-8fa3-a2ad9112a25f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.156434 Oct 16 01:03:35.091051 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 303/636] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:34 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:35.131644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:35.132300 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:35.139818 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.140290 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.140727 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.141452 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.141910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.142333 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.291154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.299869 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-81b87c18-f9f3-41e5-b40f-4fa56ffe1c1c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1555 microversion: 2.1 time: 0.172043 Oct 16 01:03:35.300454 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 334/637] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:35 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:35.322966 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:35.323449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:35.330226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.330707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.331126 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.331825 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.332269 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.332712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.411583 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4e8d6c38-6312-4a1b-b2be-9b31d608a01b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092553 Oct 16 01:03:35.412307 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 304/638] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 16 01:03:35 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:36.114995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.116034 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:36.124614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.125238 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.125879 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.126773 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.127618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.128381 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.333119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.350747 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.352519 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.353738 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-794c17fd-bf1e-45ba-87be-f7487b43e620 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.243684 Oct 16 01:03:36.368872 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 335/639] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:36.448526 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee3d0df-6e99-43f2-91f7-eaf717c48f37", "tag": "6e027178-56fc-448f-a03c-fa36b8b606db"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:36.461530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.462013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.462446 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.483933 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] Creating event network-changed:6e027178-56fc-448f-a03c-fa36b8b606db for instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 on hv-cinder-maste Oct 16 01:03:36.492974 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-e83a8f17-a9aa-4ab6-b4b2-a8d53033adcb req-df4dd625-d5f2-444d-9e98-5eded755672d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048195 Oct 16 01:03:36.493976 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 305/640] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:37.385052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.386402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:37.399428 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.399930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.403620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.410719 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.411605 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.412526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.663814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.692098 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.693574 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.694760 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7f695a13-c350-4869-9aba-e743cd4a60a5 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.314733 Oct 16 01:03:37.695320 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 336/641] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:38.086654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.093995 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:38.101719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.102176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.102891 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.103678 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.104196 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.104680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.145347 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d5bc0e79-5e22-48b3-bee9-d769ebb11ca7 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/ips" status: 200 len: 147 microversion: 2.1 time: 0.064459 Oct 16 01:03:38.145935 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 306/642] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/ips => generated 147 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:38.724643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.726008 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:38.733672 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.734166 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.734600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.735309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.735753 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.736400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.883588 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:38.886998 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:38.893695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:38.895390 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:38.897613 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ef40c709-514b-4c10-baf1-259ca54556e9 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.177036 Oct 16 01:03:38.899116 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 337/643] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:39.550449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a4611c-518a-43fe-9bb0-8feceec2ed70"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:39.552876 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:39.559597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.560077 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.560509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.561308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.561764 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.562189 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.923847 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:39.924489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:39.932108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.932937 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.933381 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.934089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.934548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.934977 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:40.072777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:40.086136 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:40.089124 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:40.090572 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6a37fa1c-2134-40e4-893c-26b29adfcfdd tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.170719 Oct 16 01:03:40.091897 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 338/644] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:39 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:41.117214 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:41.117960 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:41.124331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.124818 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.125284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.126036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.126490 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.126912 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.263166 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:41.271386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:41.272826 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:41.274223 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4542a68d-e202-40f3-886f-acb94e1263f7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.161077 Oct 16 01:03:41.274786 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 339/645] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:41 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:42.299698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.300379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:42.307262 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.307825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.308332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.309130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.309666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.310139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.445088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:42.454291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:42.455718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:42.456906 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-587bedaa-173c-4813-9866-f75cfd2da9c1 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.161205 Oct 16 01:03:42.457477 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 340/646] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:42 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:43.481947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.482623 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:43.489412 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.489919 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.490347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.491058 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.491508 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.491934 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.633910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.642464 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.643978 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.645179 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-77cc905d-cdb0-452a-9c03-32952e3bce4c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.167243 Oct 16 01:03:43.645928 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 341/647] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:44.669653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:44.670752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:44.677854 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.678367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.678802 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.679496 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.679951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.680446 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.815360 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:44.824329 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:44.825795 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:44.827097 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7aed135e-2694-4216-8015-cac6b5eb6713 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.161484 Oct 16 01:03:44.827664 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 342/648] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:44 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:45.858050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:45.859202 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:45.870610 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.871411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.872205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.873505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.873967 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.874394 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.012473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:46.021177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:46.022622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:46.023775 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fe567742-8254-4e9a-aeb5-aff0a60eeb90 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.172585 Oct 16 01:03:46.024338 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 343/649] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:47.053392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:47.054419 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:47.065311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.066125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.066850 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.067987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.068749 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.069657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.210514 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:47.219343 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:47.221130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:47.222262 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-84e0b5b8-9aa8-4df6-a772-d96cd441837e tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.175448 Oct 16 01:03:47.222830 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 344/650] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:47 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:48.251627 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:48.252590 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:48.256204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:48.265283 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.266119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.266830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.267956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.268695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.269400 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.403017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:48.411485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:48.412951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:48.414108 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-55a77bdd-983e-4180-94f0-b19c0369e3ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.169199 Oct 16 01:03:48.414643 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 345/651] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:48 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:49.445890 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:49.446555 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:49.455146 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.455640 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.456079 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.456798 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.457301 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.457748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.556817 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:49.603982 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.612414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.613876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.615017 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c7441d39-cc19-4e39-96f7-517b9bef71a7 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.175370 Oct 16 01:03:49.615573 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 346/652] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:49 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:49.637398 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=26 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:50.212063 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cc771a34-cadf-4a10-8d13-f5f990140f23 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.665392 Oct 16 01:03:50.212804 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 307/653] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:03:39 2022] POST /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 194 bytes in 10667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:50.645443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:50.646095 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:50.654936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.655583 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.656154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.657114 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.657718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.658280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.983466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.991623 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.993119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.994266 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-30df0b37-b9e6-4a94-8505-6c8f52978083 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.354116 Oct 16 01:03:50.994828 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 347/654] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:50 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:52.027301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.028391 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:52.035504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.035978 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.036407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.037125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.037569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.037985 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.168658 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.178118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.179649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.180710 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-34819d56-02e7-4dbb-8ce9-21473a4bea6f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.161403 Oct 16 01:03:52.181281 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 308/655] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:52.473478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.475736 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:52.482755 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.483244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.483669 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.484362 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.484813 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.485266 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.515320 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-bd62461a-6f53-417d-9af7-5a4564fe0684 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Oct 16 01:03:52.515880 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 348/656] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:52.526907 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.532930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:52.539683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.540255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.540701 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.541443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.541906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.542331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.572174 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d37ff391-239f-4559-83cf-8ddf66b42057 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70" status: 200 len: 194 microversion: 2.1 time: 0.049281 Oct 16 01:03:52.572756 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 309/657] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:53.210503 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:53.211377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:53.221950 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.222737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.223446 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.224566 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.225353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.226047 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.360226 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:53.369163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:53.370877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:53.372220 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-09d8233f-266f-42db-89d6-48dd28b44ad0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.168328 Oct 16 01:03:53.372777 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 349/658] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:53 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:53.912435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c0602e-cd7b-4477-a888-673820c1856a"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:53.914943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:53.922019 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.922517 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.922955 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.923653 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.924106 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.924533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.213959 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8a0dd85c-dfd4-4a2f-848a-bd9af32df1e5 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "POST /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304652 Oct 16 01:03:54.214976 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 310/659] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:03:53 2022] POST /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:54.397489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.398799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.405527 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.406258 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.406856 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.407713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.408475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.409071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.538409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "name": "network-vif-plugged", "status": "completed", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:54.543465 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.548621 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.549331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.549757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.562543 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] Creating event network-vif-plugged:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:03:54.562886 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.567532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.568945 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-b2a746dc-8948-4262-a3aa-01bc47c2480f req-a7c8b548-6813-466f-a072-07f90e3f2ecb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034119 Oct 16 01:03:54.569821 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 311/660] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:54.570336 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b6957f30-1712-4ab6-bbbc-1bc31dbe99a0 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.176243 Oct 16 01:03:54.570977 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 350/661] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:54 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:55.601755 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:55.602882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:55.613507 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.614296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.615005 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.616132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.616900 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.617613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.755329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.763662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.765127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.766277 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2dbc706d-0299-401c-bfe0-89980b0cc689 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.172668 Oct 16 01:03:55.766839 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 312/662] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:55 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:56.487380 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.489676 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.496226 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.496709 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.497173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.497928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.498380 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.498829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.528588 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4784b62e-51bf-4c60-bc78-61c631559e72 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045120 Oct 16 01:03:56.529280 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 351/663] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:56.679452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.680306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.691039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.691821 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.692532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.693710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.694455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.695180 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.728392 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e8e3ba51-8b89-41ec-b597-b2ef58f89db2 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70" status: 200 len: 194 microversion: 2.1 time: 0.055431 Oct 16 01:03:56.728893 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 313/664] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:56.739680 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.740167 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.746422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.746903 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.747332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.748018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.748473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.748949 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.791443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.792053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.798043 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.798525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.798959 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.799675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.800096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.800518 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.831735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lazy-loading 'services' on Instance uuid 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:56.905383 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-748f50cb-96c3-436e-9be0-7b6e27752423 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70" status: 202 len: 0 microversion: 2.1 time: 0.169479 Oct 16 01:03:56.906250 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 352/665] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:03:56 2022] DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/a3a4611c-518a-43fe-9bb0-8feceec2ed70 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:56.933074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.941780 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.943211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.944354 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-941f1438-e42f-42ea-9434-4d6149ed5c4f tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.156884 Oct 16 01:03:56.944925 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 314/666] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:57.971635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:57.972398 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:57.980217 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:57.980785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:57.981315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:57.982087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:57.982612 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:57.983040 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:58.118068 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:58.122133 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:58.128635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:58.130710 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:58.132203 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0ba82bd1-212a-407a-9019-610ae7631884 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1730 microversion: 2.20 time: 0.166191 Oct 16 01:03:58.132770 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 353/667] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:57 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:59.098636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:59.099185 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:59.106591 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.107396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.107834 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.108533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.109042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.109439 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.139904 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3a294b1f-a34b-44a9-8caa-2157dfb6c513 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/75c0602e-cd7b-4477-a888-673820c1856a" status: 200 len: 194 microversion: 2.1 time: 0.045661 Oct 16 01:03:59.140485 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 315/668] 10.222.0.13 () {58 vars in 1413 bytes} [Sun Oct 16 01:03:59 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/75c0602e-cd7b-4477-a888-673820c1856a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:59.153873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:59.154444 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:59.157689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:59.158294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:59.161521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.162009 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.162442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.163167 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.163621 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.164045 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.164185 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.164667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.165137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.165832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.166282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.166700 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.244657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lazy-loading 'services' on Instance uuid 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:59.297893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:59.307260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:59.308741 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:59.310362 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-19b7fb70-8c9b-49e0-b7ed-77f5e55cc934 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1717 microversion: 2.20 time: 0.156202 Oct 16 01:03:59.311009 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 316/669] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:59 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:03:59.325404 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-86024353-447b-42be-8e0c-1d72ad9aaf94 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/75c0602e-cd7b-4477-a888-673820c1856a" status: 202 len: 0 microversion: 2.1 time: 0.177406 Oct 16 01:03:59.326057 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 354/670] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:03:59 2022] DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments/75c0602e-cd7b-4477-a888-673820c1856a => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:00.512875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:00.515179 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.522151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.522631 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.523059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.523751 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.524203 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.524619 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.553681 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5ff6c79c-403a-460a-856d-2c2852a9d1ab tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044779 Oct 16 01:04:00.554401 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 317/671] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:00 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:04:00.675475 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:00.677871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.684083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.684569 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.685100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.685786 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.686239 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.686661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.716572 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a950c49a-d6fb-45ca-9b41-674648e8ee27 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045948 Oct 16 01:04:00.717153 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 355/672] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:00 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:04:00.780075 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:00.780563 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.786863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.787339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.787772 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.788440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.788885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.789327 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.814660 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:00.897663 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1e555caa-1e60-43e4-9341-9aff2acc34a0 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 204 len: 0 microversion: 2.1 time: 0.121073 Oct 16 01:04:00.898297 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 318/673] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:00 2022] DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:00.907080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:00.907614 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.913732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.914211 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.914667 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.915347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.915793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.916209 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.047061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:01.054860 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b5f9dc71-f97b-4983-b366-58eaca19fa7f tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1672 microversion: 2.1 time: 0.152100 Oct 16 01:04:01.055453 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 356/674] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:00 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:02.079511 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:02.080192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:02.087160 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:02.087646 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:02.088135 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:02.088861 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:02.089343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:02.089762 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:02.227208 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:02.235644 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c1cafdc6-993c-4c64-98bf-b961da1f6b0e tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1672 microversion: 2.1 time: 0.160754 Oct 16 01:04:02.236213 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 319/675] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:02 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:03.260280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:03.260938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:03.269058 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.269800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.270423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.271471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.272153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.272763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.405240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:03.413122 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c8f970bb-db2e-4357-8eab-37c943747518 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1672 microversion: 2.1 time: 0.157413 Oct 16 01:04:03.413784 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 357/676] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:03 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:03.917056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11074c3e-57cc-4f5b-8164-2fcc26b7c2f6", "name": "network-vif-deleted", "tag": "9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:03.927543 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.928012 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.928435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.939423 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] Creating event network-vif-deleted:9b8a2b75-d609-4aa3-b6a5-bf3ebc2277ad for instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 on hv-cinder-maste Oct 16 01:04:03.944268 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-d641b56a-00d6-4aea-925b-52d549daaa20 req-00533b0e-3f4a-42bc-9321-fb5721215077 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030860 Oct 16 01:04:03.944903 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 320/677] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:04.435827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:04.436466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:04.444772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:04.445423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:04.446274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:04.446951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:04.447424 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:04.448014 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:04.483318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:04.483802 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:04.484415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:04.484882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lazy-loading 'fault' on Instance uuid 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:04.527912 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63527c420b154db4abb6e832e46ccd05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467164d5c9154ed5ad79e0257e95de97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:04.535765 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3f8a98ec-e1c9-43be-b91f-9e4186e94ae8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 200 len: 1325 microversion: 2.1 time: 0.103898 Oct 16 01:04:04.536505 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 358/678] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:04 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:05.563660 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.564544 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:05.572665 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.573296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.573834 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.574676 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.575241 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.575941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.594587 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 HTTP/1.1 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:05.596499 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:05.598073 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '11074c3e-57cc-4f5b-8164-2fcc26b7c2f6'} Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:05.598794 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:05.600010 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:05.601142 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:05.601142 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f6f646ef-087e-483e-86e8-84ea04481653 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 404 len: 111 microversion: 2.1 time: 0.041366 Oct 16 01:04:05.601142 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 321/679] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:05.607182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a4d8f60b-821f-4245-820a-f51c3a9a7583 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '.version_select at 0x7f5806e210d0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.626724 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a4d8f60b-821f-4245-820a-f51c3a9a7583 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87686608" status: 202 len: 0 microversion: 2.1 time: 0.023534 Oct 16 01:04:05.627325 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 359/680] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 16 01:04:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87686608 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:08.541740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.542221 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:08.549056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.549548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.549981 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.550671 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.551123 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.551546 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.555730 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:08.565654 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 HTTP/1.1 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:08.567187 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.568608 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '11074c3e-57cc-4f5b-8164-2fcc26b7c2f6'} Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:08.569510 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.570863 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.572257 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:08.572257 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b55a423b-7e28-4cf7-935c-2ee750f6595c tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 404 len: 111 microversion: 2.1 time: 0.030720 Oct 16 01:04:08.572257 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 322/681] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:08 2022] DELETE /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:08.577817 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.578425 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:08.585426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.585907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.586375 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.587053 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.587503 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.587921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.601655 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 HTTP/1.1 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:08.603322 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.604787 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '11074c3e-57cc-4f5b-8164-2fcc26b7c2f6'} Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:08.605693 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. Oct 16 01:04:08.607185 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:08.608505 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:08.608505 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8592996e-f717-44d7-a9b6-8c0acb8238d4 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6" status: 404 len: 111 microversion: 2.1 time: 0.031394 Oct 16 01:04:08.608505 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 360/682] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:08 2022] GET /compute/v2.1/servers/11074c3e-57cc-4f5b-8164-2fcc26b7c2f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:09.762742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.763261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.770331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.770856 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.771369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.772024 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.772475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.772875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.787150 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 HTTP/1.1 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:09.788672 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.790178 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '630316f0-8515-4ba3-b433-29c96907a8b2'} Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:09.790988 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.792297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.793744 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:09.793744 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a5f01e4c-ea4d-4121-98ca-7797eb2a56b8 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 404 len: 111 microversion: 2.1 time: 0.031937 Oct 16 01:04:09.793744 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 323/683] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:09 2022] DELETE /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:09.798618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.799233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] [instance: 630316f0-8515-4ba3-b433-29c96907a8b2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.805965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.806454 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.806888 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.807585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.808041 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.808466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.821766 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] HTTP exception thrown: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Request method failure captured: Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 HTTP/1.1 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1a0QWoQiEQ1FqathNH-u-3AzJAZsms91Ws9JiSnYIBtWdSJ9wFxwAd1rI_3zhIgBRnacV8_Qi5crtgAxlF4Ioe7pL6BoURU-mn_eLn0NJEnEqzNRYy756ga4QSlE9b1C7XaGgHo5469PYGFB_koBfXrjOwNMdSL7366CdMXUlhC8pA Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:09.823270 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_467164d5c9154ed5ad79e0257e95de97", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/467164d5c9154ed5ad79e0257e95de97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/467164d5c9154ed5ad79e0257e95de97"}]}] Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 467164d5c9154ed5ad79e0257e95de97 Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeTestJSON-707419116 Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 63527c420b154db4abb6e832e46ccd05 Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeTestJSON-707419116-project Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.824824 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '630316f0-8515-4ba3-b433-29c96907a8b2'} Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:09.825893 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. Oct 16 01:04:09.827365 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.828743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] Returning 404 to user: Instance 630316f0-8515-4ba3-b433-29c96907a8b2 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:09.828743 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3a02ae90-ff50-466d-9751-731b48066c71 tempest-AttachVolumeTestJSON-707419116 tempest-AttachVolumeTestJSON-707419116-project] 10.222.0.13 "GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2" status: 404 len: 111 microversion: 2.1 time: 0.029944 Oct 16 01:04:09.828743 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 361/684] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/servers/630316f0-8515-4ba3-b433-29c96907a8b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:04:14.466962 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ff4999d0-8b1a-4bad-aaa8-a3fab992e0a7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Action: 'create', calling method: .version_select at 0x7f5806e69f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-467876083"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:14.755842 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ff4999d0-8b1a-4bad-aaa8-a3fab992e0a7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425740 Oct 16 01:04:14.756465 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 324/685] 10.222.0.13 () {60 vars in 1155 bytes} [Sun Oct 16 01:04:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 16 01:04:14.769546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8b1e3667-90a1-4fe2-9541-1a16e94cc561 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e4ff70>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.820173 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8b1e3667-90a1-4fe2-9541-1a16e94cc561 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 200 len: 344 microversion: 2.1 time: 0.054373 Oct 16 01:04:14.820895 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 362/686] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:15.840628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f5a545c3-319b-4ac3-88ee-4511f1c89594 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e8dee0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:15.895133 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f5a545c3-319b-4ac3-88ee-4511f1c89594 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 200 len: 345 microversion: 2.1 time: 0.061778 Oct 16 01:04:15.895737 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 325/687] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:15 2022] GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:15.909443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2cc92d38-e9d0-4feb-a75a-7024159abdf7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Action: 'create', calling method: .version_select at 0x7f5806e10700>, body: {"snapshot": {"volume_id": "191985d5-87e2-4b57-a91a-5e3c9eca3b1a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-531150485"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:16.071611 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2cc92d38-e9d0-4feb-a75a-7024159abdf7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.166561 Oct 16 01:04:16.072177 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 363/688] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 16 01:04:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:16.094691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f1b6b5a3-d495-4b9d-bb48-023b47944cf7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e87a60>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.127362 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f1b6b5a3-d495-4b9d-bb48-023b47944cf7 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 200 len: 286 microversion: 2.1 time: 0.036605 Oct 16 01:04:16.128011 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 326/689] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:16.139089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f83bd87b-bfc9-4bd7-a291-b3644483f4d3 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806ea7af0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.170052 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f83bd87b-bfc9-4bd7-a291-b3644483f4d3 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034808 Oct 16 01:04:16.170626 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 364/690] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:16.182112 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-87e86bfe-0c59-4296-9edb-d1ca89fdb973 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e8d0d0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.212991 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-87e86bfe-0c59-4296-9edb-d1ca89fdb973 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 200 len: 286 microversion: 2.1 time: 0.034626 Oct 16 01:04:16.213558 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 327/691] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:17.231481 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-30e89529-a04a-4904-83c7-50091e694571 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e10670>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.265625 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-30e89529-a04a-4904-83c7-50091e694571 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 200 len: 287 microversion: 2.1 time: 0.041581 Oct 16 01:04:17.266196 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 365/692] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:17.284006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b1f37a67-c264-416e-94b0-dfc3603ed16f tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806ed4670>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.349259 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b1f37a67-c264-416e-94b0-dfc3603ed16f tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 202 len: 0 microversion: 2.1 time: 0.071773 Oct 16 01:04:17.350120 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 328/693] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 16 01:04:17 2022] DELETE /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:17.360230 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-da09e4fd-c0ea-4243-9b5e-e04ed57658fa tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806f148b0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.395980 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-da09e4fd-c0ea-4243-9b5e-e04ed57658fa tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 200 len: 286 microversion: 2.1 time: 0.040911 Oct 16 01:04:17.396546 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 366/694] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:18.412768 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ac387af-0ce4-4d69-8be5-7aee92f34ba4 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5807041700>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:18.444748 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-1ac387af-0ce4-4d69-8be5-7aee92f34ba4 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] HTTP exception thrown: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ac387af-0ce4-4d69-8be5-7aee92f34ba4 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Request method failure captured: Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 HTTP/1.1 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1iOqRpbkKAFYN4hTh86u0V1fosePf_dBI8l0uT7Rjb1dOE0zAaCHqA_k4W0WslMWG0kRO3x-EN85hrO9cttXtX0gULsIkzcvGg3KyUyRSCKY7l3erX25nEkU_BC0iR3UwHiv5A_mGlEurmW-OI39SyKC9cztNAWWR-Du_g9YVuhEow Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:18.448052 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_911631cc9d034cc3af149f33b1ccd4b6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/911631cc9d034cc3af149f33b1ccd4b6"}]}] Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: fe72a106c05242f79e1248d7ff898416 Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '2c4c8633-7152-49b2-ab6f-8104b779f0d4'} Oct 16 01:04:18.449606 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. (HTTP 404) (Request-ID: req-92dcdecb-54f9-4b53-ad34-0b41c3e02c86) Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.450761 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:18.452228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 16 01:04:18.453733 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ac387af-0ce4-4d69-8be5-7aee92f34ba4 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Returning 404 to user: Snapshot 2c4c8633-7152-49b2-ab6f-8104b779f0d4 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:18.455249 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1ac387af-0ce4-4d69-8be5-7aee92f34ba4 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4" status: 404 len: 111 microversion: 2.1 time: 0.042623 Oct 16 01:04:18.456187 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 329/695] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 16 01:04:18 2022] GET /compute/v2.1/os-snapshots/2c4c8633-7152-49b2-ab6f-8104b779f0d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:18.458871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-51a1e62c-bd26-4910-9157-7a3ec3776d05 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806ecde50>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:18.521216 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-51a1e62c-bd26-4910-9157-7a3ec3776d05 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 202 len: 0 microversion: 2.1 time: 0.066621 Oct 16 01:04:18.521781 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 367/696] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:04:18 2022] DELETE /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:18.532313 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2f4b09c7-33b0-44e7-831e-96cc2024c878 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e69310>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:18.579579 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2f4b09c7-33b0-44e7-831e-96cc2024c878 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 200 len: 344 microversion: 2.1 time: 0.053141 Oct 16 01:04:18.580180 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 330/697] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:18 2022] GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:19.599100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8ba83238-d0e3-46b4-bfc1-a7b138861d19 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806ea74c0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:19.632130 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-8ba83238-d0e3-46b4-bfc1-a7b138861d19 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] HTTP exception thrown: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8ba83238-d0e3-46b4-bfc1-a7b138861d19 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Request method failure captured: Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a HTTP/1.1 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1iOqRpbkKAFYN4hTh86u0V1fosePf_dBI8l0uT7Rjb1dOE0zAaCHqA_k4W0WslMWG0kRO3x-EN85hrO9cttXtX0gULsIkzcvGg3KyUyRSCKY7l3erX25nEkU_BC0iR3UwHiv5A_mGlEurmW-OI39SyKC9cztNAWWR-Du_g9YVuhEow Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:19.635437 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_911631cc9d034cc3af149f33b1ccd4b6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/911631cc9d034cc3af149f33b1ccd4b6"}]}] Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: fe72a106c05242f79e1248d7ff898416 Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '191985d5-87e2-4b57-a91a-5e3c9eca3b1a'} Oct 16 01:04:19.636944 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. (HTTP 404) (Request-ID: req-1635b842-5d0a-40df-84bb-6c3a459e8f3b) Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.637916 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:19.639394 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:04:19.640732 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8ba83238-d0e3-46b4-bfc1-a7b138861d19 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Returning 404 to user: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8ba83238-d0e3-46b4-bfc1-a7b138861d19 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 404 len: 109 microversion: 2.1 time: 0.045636 Oct 16 01:04:19.642371 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 368/698] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:19 2022] GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:19.647285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6a5b34bc-2240-4495-8435-e0074940d35d tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806e874c0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:19.676272 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-6a5b34bc-2240-4495-8435-e0074940d35d tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] HTTP exception thrown: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6a5b34bc-2240-4495-8435-e0074940d35d tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Request method failure captured: Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a HTTP/1.1 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1iOqRpbkKAFYN4hTh86u0V1fosePf_dBI8l0uT7Rjb1dOE0zAaCHqA_k4W0WslMWG0kRO3x-EN85hrO9cttXtX0gULsIkzcvGg3KyUyRSCKY7l3erX25nEkU_BC0iR3UwHiv5A_mGlEurmW-OI39SyKC9cztNAWWR-Du_g9YVuhEow Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:19.678602 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_911631cc9d034cc3af149f33b1ccd4b6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/911631cc9d034cc3af149f33b1ccd4b6"}]}] Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: fe72a106c05242f79e1248d7ff898416 Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '191985d5-87e2-4b57-a91a-5e3c9eca3b1a'} Oct 16 01:04:19.680075 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. (HTTP 404) (Request-ID: req-94418c34-a457-4003-bbaf-5a1b2ae49e5d) Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.681022 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:04:19.682369 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:04:19.683686 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6a5b34bc-2240-4495-8435-e0074940d35d tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Returning 404 to user: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6a5b34bc-2240-4495-8435-e0074940d35d tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 404 len: 109 microversion: 2.1 time: 0.037041 Oct 16 01:04:19.685094 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 331/699] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:04:19 2022] DELETE /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:19.689467 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35a01186-bf1b-4169-93e4-c5ea5f1c1308 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Calling method '.version_select at 0x7f5806ea7310>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:19.717203 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-35a01186-bf1b-4169-93e4-c5ea5f1c1308 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] HTTP exception thrown: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35a01186-bf1b-4169-93e4-c5ea5f1c1308 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Request method failure captured: Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a HTTP/1.1 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1iOqRpbkKAFYN4hTh86u0V1fosePf_dBI8l0uT7Rjb1dOE0zAaCHqA_k4W0WslMWG0kRO3x-EN85hrO9cttXtX0gULsIkzcvGg3KyUyRSCKY7l3erX25nEkU_BC0iR3UwHiv5A_mGlEurmW-OI39SyKC9cztNAWWR-Du_g9YVuhEow Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:19.719195 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_911631cc9d034cc3af149f33b1ccd4b6", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/911631cc9d034cc3af149f33b1ccd4b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/911631cc9d034cc3af149f33b1ccd4b6"}]}] Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 911631cc9d034cc3af149f33b1ccd4b6 Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112750556 Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: fe72a106c05242f79e1248d7ff898416 Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112750556-project Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '191985d5-87e2-4b57-a91a-5e3c9eca3b1a'} Oct 16 01:04:19.721024 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. (HTTP 404) (Request-ID: req-d9e8f11b-e7a1-4208-8c07-d0a69bfeb9bf) Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.721937 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:19.723522 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:04:19.725064 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35a01186-bf1b-4169-93e4-c5ea5f1c1308 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] Returning 404 to user: Volume 191985d5-87e2-4b57-a91a-5e3c9eca3b1a could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-35a01186-bf1b-4169-93e4-c5ea5f1c1308 tempest-VolumesSnapshotsTestJSON-2112750556 tempest-VolumesSnapshotsTestJSON-2112750556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a" status: 404 len: 109 microversion: 2.1 time: 0.035448 Oct 16 01:04:19.726410 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 369/700] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:19 2022] GET /compute/v2.1/os-volumes/191985d5-87e2-4b57-a91a-5e3c9eca3b1a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:04:21.039394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:21.040204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:21.167775 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a164f09c-4124-43f9-92a8-36599cf08d6b tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Action: 'create', calling method: .version_select at 0x7f5806e87280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1350069186", "metadata": {"Type": "work"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:21.477006 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a164f09c-4124-43f9-92a8-36599cf08d6b tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.438179 Oct 16 01:04:21.479669 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 332/701] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 16 01:04:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 16 01:04:21.487521 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:21.488357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:21.493285 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-955959bb-65f2-41c2-a787-d578d2783ac1 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5806e833a0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:21.542773 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-955959bb-65f2-41c2-a787-d578d2783ac1 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 200 len: 353 microversion: 2.1 time: 0.055975 Oct 16 01:04:21.543346 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 370/702] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:21 2022] GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:22.563591 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0ee9411c-a3b6-4f82-8dca-ba71630fcd2d tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5806e24310>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:22.617119 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0ee9411c-a3b6-4f82-8dca-ba71630fcd2d tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 200 len: 354 microversion: 2.1 time: 0.060694 Oct 16 01:04:22.617683 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 333/703] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:22 2022] GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:22.631169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9aa06221-a320-4eae-a5ed-bc6beaa5dd5e tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5806ecdf70>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:22.680296 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9aa06221-a320-4eae-a5ed-bc6beaa5dd5e tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 200 len: 354 microversion: 2.1 time: 0.053102 Oct 16 01:04:22.681055 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 371/704] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:22 2022] GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:22.706356 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-61e93aa3-b8ca-4d9c-9b74-9459ef4db1ce tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5806e6f5e0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:22.771656 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-61e93aa3-b8ca-4d9c-9b74-9459ef4db1ce tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 202 len: 0 microversion: 2.1 time: 0.070204 Oct 16 01:04:22.772231 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 334/705] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:04:22 2022] DELETE /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:04:22.780441 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2baac109-cb9d-49f3-98ef-f2a30e8b6258 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5806dfc160>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:22.828659 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2baac109-cb9d-49f3-98ef-f2a30e8b6258 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 200 len: 353 microversion: 2.1 time: 0.051935 Oct 16 01:04:22.829264 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 372/706] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:22 2022] GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:04:23.848397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2e5eb152-c525-4a2f-ae89-69c6e3500c70 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Calling method '.version_select at 0x7f5807e2dee0>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:23.888015 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-2e5eb152-c525-4a2f-ae89-69c6e3500c70 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] HTTP exception thrown: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2e5eb152-c525-4a2f-ae89-69c6e3500c70 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Request method failure captured: Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 HTTP/1.1 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1iUv6OHsbdtr4MRXnVGOht9HdgCpSopK3KtdfoLzwUnK9SwnC-TT-yMfOIphYgJp52YzE09De62X8Vl38OEzzuvilvWsqbp1DvIqLp9UcYqobDuGibNnnTv-E0OrXmN-ZFbktSuwsl8uJbGHHAlVW-QXn7RIe37n2FfOE7TUbnFyH8 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 2cb83a064fc14150b8b937617c13d54e Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesGetTestJSON-1324881839 Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:04:23.889976 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2cb83a064fc14150b8b937617c13d54e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2cb83a064fc14150b8b937617c13d54e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2cb83a064fc14150b8b937617c13d54e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2cb83a064fc14150b8b937617c13d54e"}]}] Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesGetTestJSON-1324881839 Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 2cb83a064fc14150b8b937617c13d54e Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesGetTestJSON-1324881839 Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesGetTestJSON-1324881839-project Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: b1acd08fa0764506b261d2f983d6a2da Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesGetTestJSON-1324881839-project Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'c61cf31b-4ba4-4e41-997f-d0a6118eaaf8'} Oct 16 01:04:23.891421 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. (HTTP 404) (Request-ID: req-d81e5e75-64c0-4afb-a84a-a19f34c31cb6) Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:23.892466 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:23.893695 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:04:23.895055 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2e5eb152-c525-4a2f-ae89-69c6e3500c70 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] Returning 404 to user: Volume c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2e5eb152-c525-4a2f-ae89-69c6e3500c70 tempest-VolumesGetTestJSON-1324881839 tempest-VolumesGetTestJSON-1324881839-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8" status: 404 len: 109 microversion: 2.1 time: 0.050856 Oct 16 01:04:23.896377 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 335/707] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:04:23 2022] GET /compute/v2.1/os-volumes/c61cf31b-4ba4-4e41-997f-d0a6118eaaf8 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:37.733422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-975067539", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:37.790877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] validate_networks() for None {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:38.073236 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:38.073654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:38.074122 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:38.074524 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:38.074932 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:38.084533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.085436 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.085540 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.086263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.086723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.087149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.105028 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Getting quotas for project 864ff2f532f740a6b730c62db550497a. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:38.109307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Getting quotas for user 576d7d47bc93483da359a8d30f1f2dcb and project 864ff2f532f740a6b730c62db550497a. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:38.120810 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:38.123163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:38.168314 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a75b41e1-2b84-400f-aaa4-ed43192f4371 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439390 Oct 16 01:04:38.168984 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 373/708] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:38.181385 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c123b00e-5cd4-4b58-b7fe-0100bacc0fe0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.181987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c123b00e-5cd4-4b58-b7fe-0100bacc0fe0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.236608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c123b00e-5cd4-4b58-b7fe-0100bacc0fe0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.243559 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c123b00e-5cd4-4b58-b7fe-0100bacc0fe0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1214 microversion: 2.1 time: 0.067350 Oct 16 01:04:38.244128 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 336/709] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.266572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:39.267196 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.274071 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.274559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.275001 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.275698 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.276154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.276585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.338862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:39.347087 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-710a425c-9270-42fd-b286-a89c621dd06b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1266 microversion: 2.1 time: 0.084648 Oct 16 01:04:39.347659 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 374/710] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:39 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:40.370349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:40.371046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:40.377866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.378367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.378801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.379498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.379952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.380362 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.444409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:40.452137 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-21c96c2d-87d4-48a4-980a-de14b7baf504 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1272 microversion: 2.1 time: 0.085800 Oct 16 01:04:40.452684 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 337/711] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:40 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:41.479437 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:41.480133 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:41.489265 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:41.489770 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:41.490935 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:41.491693 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:41.492185 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:41.492780 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:41.523665 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd331217-2969-467f-87fd-2d53d48837a6", "tag": "45a95fe8-4134-4d9e-b53b-b7085631259a"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:41.534242 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:41.534732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:41.535188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:41.550128 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] Creating event network-changed:45a95fe8-4134-4d9e-b53b-b7085631259a for instance bd331217-2969-467f-87fd-2d53d48837a6 on hv-cinder-maste Oct 16 01:04:41.556450 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-60bb0ba3-607d-4453-afc3-cb15f85c8988 req-9c0b5b0c-f97b-44f4-9a57-c5c3f2d2ab53 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036372 Oct 16 01:04:41.557096 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 338/712] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:04:41.631061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:41.638731 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-45c170a8-a468-4c4a-9a20-2d88db993f5b tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.166521 Oct 16 01:04:41.639290 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 375/713] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:41 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:42.666919 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:42.668054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:42.676065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:42.676545 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:42.677010 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:42.677729 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:42.678182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:42.678604 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:42.815978 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:42.823680 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-774f99ae-ccb1-4c87-99a9-9a1df1fc4825 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.164538 Oct 16 01:04:42.824274 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 339/714] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:42 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:43.851201 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:43.852220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:43.864480 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.865862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.866764 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.868941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.870852 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.871974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.011560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.019707 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e0e0b072-b60d-45c7-a995-4bcd92b9f9bc tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.175553 Oct 16 01:04:44.020247 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 376/715] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:43 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:45.046739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:45.047569 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:45.055640 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.056216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.056730 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.057615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.058154 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.058657 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.188110 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:45.196219 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6d0d7b1a-4c5f-41e8-8580-5d0cc743e331 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.156267 Oct 16 01:04:45.196785 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 340/716] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:45 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:46.221769 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:46.222389 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:46.229434 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:46.229917 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:46.230352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:46.231043 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:46.231498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:46.231922 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:46.371334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:46.379778 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0de0bd2a-fe42-4de5-8746-86d7163ea64f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.163268 Oct 16 01:04:46.380345 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 377/717] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:46 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:47.403724 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:47.404307 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:47.410931 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.411431 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.411898 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.413092 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.413568 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.414081 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.548015 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:47.556149 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a7c34e16-b08e-4837-98fe-d591e4f1d833 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.156412 Oct 16 01:04:47.556724 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 341/718] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:47 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:48.579033 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:48.579639 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:48.582040 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:48.582793 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:48.588494 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.589056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.589489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.590169 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.590617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.591035 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.725992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:48.734838 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a1d47b31-6c5f-477a-9c86-02b1623226a1 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.159693 Oct 16 01:04:48.735613 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 378/719] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:48 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:48.813924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd331217-2969-467f-87fd-2d53d48837a6", "name": "network-vif-plugged", "status": "completed", "tag": "45a95fe8-4134-4d9e-b53b-b7085631259a"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:48.819134 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:48.825864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.826346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.826775 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.838053 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] Creating event network-vif-plugged:45a95fe8-4134-4d9e-b53b-b7085631259a for instance bd331217-2969-467f-87fd-2d53d48837a6 on hv-cinder-maste Oct 16 01:04:48.843761 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-cf75f996-b78b-4d4b-ac58-7c4c4c202246 req-f2c63d7f-80a1-428b-8b7b-a4735af8a471 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Oct 16 01:04:48.844809 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 342/720] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:49.761724 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:49.762654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:49.770682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:49.771190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:49.771646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:49.772366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:49.772885 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:49.773530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:49.900483 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:49.908175 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1572d00f-1b54-4d2b-abc0-7180bd0d3abf tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.152957 Oct 16 01:04:49.908747 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 379/721] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:49 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:50.942282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:50.943193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:50.951929 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:50.952725 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:50.953524 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:50.954299 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:50.954689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:50.955111 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.086248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.096965 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4e05e243-3c16-43a1-ac5e-0fba98d2a78f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1314 microversion: 2.1 time: 0.160831 Oct 16 01:04:51.097771 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 343/722] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:50 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.016799 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.017458 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.024696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.025218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.025655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.026353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.026807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.027229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.050839 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-30149e4e-2604-475a-a608-2a4509e5dd42 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/ips" status: 200 len: 149 microversion: 2.1 time: 0.039918 Oct 16 01:04:52.051405 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 380/723] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:52.123684 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.124309 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.131211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.131696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.132125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.132813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.133294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.133710 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.267916 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:52.277371 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1c1fc39a-26be-4e11-bd75-75470725ca5f tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1464 microversion: 2.1 time: 0.157317 Oct 16 01:04:52.278630 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 344/724] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.341456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.341956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.348451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.349086 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.349674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.350059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.350548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.351002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.378414 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:52.457001 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a14e390c-68a6-41fa-8ea2-f3d804a669a0 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 204 len: 0 microversion: 2.1 time: 0.119119 Oct 16 01:04:52.457686 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 381/725] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:52 2022] DELETE /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:52.466634 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.467249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.473756 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.474247 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.474686 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.475377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.475836 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.476261 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.609607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:52.617849 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ac51f3ae-419f-448e-b57c-888dab4da521 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1470 microversion: 2.1 time: 0.155321 Oct 16 01:04:52.618424 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 345/726] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:53.408992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9ccbbae-d73d-4b73-8fe5-091c62516488"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:53.411541 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.418054 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.418546 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.418973 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.419656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.420107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.420524 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.642683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:53.643470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.652123 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.652792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.653483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.654409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.655070 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.655695 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.790719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.798961 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9f386bca-c832-4303-a8b7-fad6ec58f948 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1470 microversion: 2.1 time: 0.161147 Oct 16 01:04:53.799797 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 346/727] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:53 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:53.826217 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-58564e10-11fa-474e-a441-1d4a773e0ecf tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "POST /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421489 Oct 16 01:04:53.826820 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 382/728] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:04:53 2022] POST /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:54.612586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd331217-2969-467f-87fd-2d53d48837a6", "name": "network-vif-deleted", "tag": "45a95fe8-4134-4d9e-b53b-b7085631259a"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:54.622367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.622841 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.623263 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.634906 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] Creating event network-vif-deleted:45a95fe8-4134-4d9e-b53b-b7085631259a for instance bd331217-2969-467f-87fd-2d53d48837a6 on hv-cinder-maste Oct 16 01:04:54.639902 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-cdd592b3-57a2-4229-8cfe-26351afd293e req-7c0f3267-835c-4d93-a36e-13f9202b5930 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Oct 16 01:04:54.640484 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 347/729] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:54.823689 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:54.824382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:54.831029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.831668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.832132 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.832825 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.833311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.833729 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.852243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:54.854575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:54.862925 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.863835 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.864340 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.865333 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.865781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.866930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.898204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:54.903094 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-35fb6164-f35c-44a5-9c47-9d74e7e7e7ae tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055114 Oct 16 01:04:54.904198 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 348/730] 10.222.0.13 () {60 vars in 1343 bytes} [Sun Oct 16 01:04:54 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:54.915379 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fe6a5b1a-4d8e-42ba-950e-c26890908047 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1428 microversion: 2.1 time: 0.096047 Oct 16 01:04:54.916495 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 383/731] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:54 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:54.976572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:54.977271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:54.984337 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.984923 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.985442 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.986195 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.986705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.987186 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.013389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:55.092863 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5787aa4a-2391-49a0-8731-30cebba47e5c tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 204 len: 0 microversion: 2.20 time: 0.120095 Oct 16 01:04:55.093559 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 349/732] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 16 01:04:54 2022] DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:04:55.102448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:55.103067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:55.109741 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.110229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.110663 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.111347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.111801 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.112225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.238552 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:55.246991 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:55.248429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:55.249755 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a705cdfc-51bc-4a1a-9289-7af9de25de81 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.151056 Oct 16 01:04:55.250340 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 384/733] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:55 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:55.944583 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:55.945785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:55.956490 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.957532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.958262 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.959390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.960133 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.960988 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.995694 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.996229 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.996669 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.997266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lazy-loading 'fault' on Instance uuid bd331217-2969-467f-87fd-2d53d48837a6 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:56.039490 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.048531 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-270e1687-6d88-4db4-98fa-157e56f87973 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1304 microversion: 2.1 time: 0.110816 Oct 16 01:04:56.049537 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 350/734] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:55 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:56.278913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:56.279911 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:56.290696 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.291515 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.292238 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.293412 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.294163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.294870 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.424464 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.434999 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.436531 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.437786 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6af9b8a9-baf9-489c-8dbe-b173b5ef0c93 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.165411 Oct 16 01:04:56.438641 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 385/735] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:56 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:57.072508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.073707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.088949 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.089445 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.089877 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.090578 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.091027 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.091452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.136314 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.136801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.137362 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.137683 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lazy-loading 'fault' on Instance uuid bd331217-2969-467f-87fd-2d53d48837a6 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:57.201971 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576d7d47bc93483da359a8d30f1f2dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864ff2f532f740a6b730c62db550497a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.209465 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-eca1c61f-64c6-4742-aad5-ecbe1e9197ed tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 200 len: 1304 microversion: 2.1 time: 0.141742 Oct 16 01:04:57.210035 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 351/736] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:57.276522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.277277 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.283439 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.284029 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.284352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.285126 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.285580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.286072 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.366508 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lazy-loading 'services' on Instance uuid fee3d0df-6e99-43f2-91f7-eaf717c48f37 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:57.433637 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:57.447503 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0612df82-168d-40f8-806f-c3b2fe74d60d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments/e9ccbbae-d73d-4b73-8fe5-091c62516488" status: 202 len: 0 microversion: 2.1 time: 0.174394 Oct 16 01:04:57.448606 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 386/737] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:04:57 2022] DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments/e9ccbbae-d73d-4b73-8fe5-091c62516488 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:57.458073 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.460432 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.466887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.467400 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.467875 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.468923 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.470538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.471974 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.474270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.475677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.487180 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.488130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.489059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.490383 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.491291 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.492153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.505192 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0eb54859-08b2-4c08-b736-2559fbfcf965 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Oct 16 01:04:57.505733 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 352/738] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:57.639688 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.648283 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.649750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.650912 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e82aba2f-0af3-4022-ab9f-bc5af85485bb tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1723 microversion: 2.20 time: 0.188300 Oct 16 01:04:57.651519 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 387/739] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:58.028121 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008e5f6-0855-4cea-8f0f-54fc18179687", "name": "network-vif-deleted", "tag": "94df6640-b168-415b-a973-39eba35230da"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:58.037857 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.038305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.038740 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.042726 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:58.053106 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] Creating event network-vif-deleted:94df6640-b168-415b-a973-39eba35230da for instance f008e5f6-0855-4cea-8f0f-54fc18179687 on hv-cinder-maste Oct 16 01:04:58.058516 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-13278f95-1648-4acc-b1a3-375331941dbf req-e258981f-2f27-44db-9eee-d0a6a2862355 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 Oct 16 01:04:58.059496 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 353/740] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:58.235766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.236776 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] [instance: bd331217-2969-467f-87fd-2d53d48837a6] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:58.242800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.243261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.243692 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.244382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.244865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.245902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.260561 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] HTTP exception thrown: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Request method failure captured: Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 HTTP/1.1 Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1ikyv-Zwzsd--5TCUlnHahh-8SQyqxXJ9658rheQIx56gVeKmiGYiPKV5FVzIT4KcivHwvBa5Y5wqv-0D5GccG4MltwmC-B6aIoesKL_v5LMUhL8rPaxRdK3F7IxMHzmlGLq8BJgARevaNOX74T5uy24noO7zlwsz8xn8IRxZLIsUY Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 864ff2f532f740a6b730c62db550497a Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesNegativeTest-1486314786 Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:58.262321 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_864ff2f532f740a6b730c62db550497a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/864ff2f532f740a6b730c62db550497a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/864ff2f532f740a6b730c62db550497a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/864ff2f532f740a6b730c62db550497a"}]}] Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesNegativeTest-1486314786 Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 864ff2f532f740a6b730c62db550497a Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesNegativeTest-1486314786 Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesNegativeTest-1486314786-project Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 576d7d47bc93483da359a8d30f1f2dcb Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesNegativeTest-1486314786-project Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. Oct 16 01:04:58.264003 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'bd331217-2969-467f-87fd-2d53d48837a6'} Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:58.264935 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. Oct 16 01:04:58.266668 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:58.267760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] Returning 404 to user: Instance bd331217-2969-467f-87fd-2d53d48837a6 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:58.267760 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-54015030-2ba3-4e3d-a7da-8a31d6887536 tempest-VolumesNegativeTest-1486314786 tempest-VolumesNegativeTest-1486314786-project] 10.222.0.13 "GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6" status: 404 len: 111 microversion: 2.1 time: 0.032099 Oct 16 01:04:58.267760 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 388/741] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:58 2022] GET /compute/v2.1/servers/bd331217-2969-467f-87fd-2d53d48837a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:58.522284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.524476 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:58.532305 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.532910 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.533410 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.534176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.534697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.535184 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.568149 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-de6044b5-225e-4ab7-bf25-83f2f4c024a2 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050948 Oct 16 01:04:58.568716 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 354/742] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:58 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:58.675663 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.676373 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:58.683607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.684247 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.684719 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.686026 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.686732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.687482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.727379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.727974 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.728617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.729191 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lazy-loading 'fault' on Instance uuid f008e5f6-0855-4cea-8f0f-54fc18179687 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:58.773292 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:58.786522 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:58.788477 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6538a3de44cd4650b31aab5f169a8abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2d5b3b740743ba9bba7dcf77214252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:58.789914 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ceae943d-ee4c-4fd4-9adf-53d27c641122 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 200 len: 1371 microversion: 2.20 time: 0.118302 Oct 16 01:04:58.793886 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 389/743] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:58 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:04:59.580059 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.582204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.589096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.589577 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.590000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.590688 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.591137 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.591523 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.622507 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d42e6095-6391-4d1b-8c15-30fa0b8ae101 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046479 Oct 16 01:04:59.623069 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 355/744] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:04:59.684879 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.685463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.692096 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.692578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.693037 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.693689 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.694325 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.694774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.720903 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:59.798738 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-e94d0a04-17fa-4d3a-b287-83827f1fdd8b tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 204 len: 0 microversion: 2.1 time: 0.117292 Oct 16 01:04:59.799572 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 390/745] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:59 2022] DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:59.809666 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.810366 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.817588 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.818153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.818303 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.818696 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.818993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.819556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.820074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.820561 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.824997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.825481 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.825902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.826601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.827048 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.827463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.841442 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 HTTP/1.1 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:04:59.843204 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:04:59.845221 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'f008e5f6-0855-4cea-8f0f-54fc18179687'} Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:59.849750 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:04:59.851257 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:04:59.852585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:59.852585 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-0600b422-c0cb-43fa-9a8b-11a10a876efa tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 404 len: 111 microversion: 2.20 time: 0.030724 Oct 16 01:04:59.852585 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 391/746] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:04:59.853585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7ffd65aa-964e-4de2-9548-188da3cc912d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '.version_select at 0x7f5806e109d0>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.874388 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7ffd65aa-964e-4de2-9548-188da3cc912d tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063555069" status: 204 len: 0 microversion: 2.20 time: 0.024303 Oct 16 01:04:59.874973 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 392/747] 10.222.0.13 () {60 vars in 1262 bytes} [Sun Oct 16 01:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063555069 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:04:59.963685 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:59.973544 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5e74af41-82e2-4505-9aa4-b3edd56ffc34 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1680 microversion: 2.1 time: 0.169080 Oct 16 01:04:59.974364 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 356/748] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:00.998748 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:00.999426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:01.006641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.007143 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.007552 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.008249 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.008707 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.009179 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.342267 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:01.350749 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-261940f4-08fa-42d0-9037-2e3c4a378971 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1680 microversion: 2.1 time: 0.356518 Oct 16 01:05:01.351326 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 393/749] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:00 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1680 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:01.687994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:01.688504 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:01.695339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.695821 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.696251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.696969 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.697425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.697846 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.711633 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 HTTP/1.1 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:01.713320 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.714934 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'f008e5f6-0855-4cea-8f0f-54fc18179687'} Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:01.715966 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.717421 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.719470 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:01.719470 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2a5e9c4c-5793-4028-8f83-3fd12dd24887 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 404 len: 111 microversion: 2.20 time: 0.030609 Oct 16 01:05:01.719470 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 357/750] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 16 01:05:01 2022] DELETE /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:05:01.723421 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:01.724036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: f008e5f6-0855-4cea-8f0f-54fc18179687] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:01.730405 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.730888 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.731326 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.732014 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.732469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.732880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.746727 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 HTTP/1.1 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:01.748259 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.749917 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'f008e5f6-0855-4cea-8f0f-54fc18179687'} Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:01.751137 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. Oct 16 01:05:01.752720 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:01.754023 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance f008e5f6-0855-4cea-8f0f-54fc18179687 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:01.754023 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fa9412f1-ed76-41f8-b491-1e171d4604df tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687" status: 404 len: 111 microversion: 2.20 time: 0.030995 Oct 16 01:05:01.754023 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 394/751] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:01 2022] GET /compute/v2.1/servers/f008e5f6-0855-4cea-8f0f-54fc18179687 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:05:02.375428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.376124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.382172 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.382650 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.383066 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.383746 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.384195 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.384728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.453576 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da699bb0c51440593b8175d05869203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94363b1b0a0d48229b3bef2b1b779d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:02.461801 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c1ee01a0-efe7-49b1-8c07-4498005a0cb6 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 200 len: 1612 microversion: 2.1 time: 0.090378 Oct 16 01:05:02.462711 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 358/752] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:02.583442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee3d0df-6e99-43f2-91f7-eaf717c48f37", "name": "network-vif-deleted", "tag": "6e027178-56fc-448f-a03c-fa36b8b606db"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:02.594687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.595173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.595800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.610362 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] Creating event network-vif-deleted:6e027178-56fc-448f-a03c-fa36b8b606db for instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 on hv-cinder-maste Oct 16 01:05:02.615926 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-83660a53-43c9-439d-ade9-4e004c2a146d req-f08a8437-7d84-4df4-ac83-6acd9858390f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Oct 16 01:05:02.616318 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 395/753] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:02.902565 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.903085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.910296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.910779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.911476 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.912175 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.912797 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.913245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.927290 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f HTTP/1.1 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:02.928880 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.930254 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'b12648b0-9359-4569-82b6-3e6fe3d53d6f'} Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:02.930995 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.932170 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.934346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:02.934346 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-991064af-f88e-4189-9505-47bbb3657b88 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 404 len: 111 microversion: 2.20 time: 0.032680 Oct 16 01:05:02.934346 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 359/754] 10.222.0.13 () {60 vars in 1280 bytes} [Sun Oct 16 01:05:02 2022] DELETE /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:05:02.940686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.941487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] [instance: b12648b0-9359-4569-82b6-3e6fe3d53d6f] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.948314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.948829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.949358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.950148 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.950660 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.951137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.964928 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] HTTP exception thrown: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Request method failure captured: Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f HTTP/1.1 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1aw7APOQXVo66R7rOA6CBTTjXEWclSHsLz3Pl23i1KZIdveCQMNwL3A615K0EZDM0JbTRKxyEz6JSWCR5JkEH1u_6aWz9I79WXMPIgrnNJiqzqyoysY642ggB2UUcVwnB5VPV2MUQYKXbCavfGayhAogHUlkH2c3-N5TBRIgzyjAKc Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:02.966686 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2d5b3b740743ba9bba7dcf77214252", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2d5b3b740743ba9bba7dcf77214252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2d5b3b740743ba9bba7dcf77214252"}]}] Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 4a2d5b3b740743ba9bba7dcf77214252 Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255281563 Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 6538a3de44cd4650b31aab5f169a8abe Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255281563-project Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.968102 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'b12648b0-9359-4569-82b6-3e6fe3d53d6f'} Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:02.968827 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. Oct 16 01:05:02.970465 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:02.971499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] Returning 404 to user: Instance b12648b0-9359-4569-82b6-3e6fe3d53d6f could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:02.971499 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1ba93901-aaa9-401b-99ec-f14f852fe266 tempest-AttachVolumeShelveTestJSON-1255281563 tempest-AttachVolumeShelveTestJSON-1255281563-project] 10.222.0.13 "GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f" status: 404 len: 111 microversion: 2.20 time: 0.032118 Oct 16 01:05:02.971499 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 396/755] 10.222.0.13 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/b12648b0-9359-4569-82b6-3e6fe3d53d6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:05:03.486395 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.487254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:03.494387 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.498204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.505842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.507008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.507649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.508278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.525990 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 HTTP/1.1 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:03.527156 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:03.528444 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'fee3d0df-6e99-43f2-91f7-eaf717c48f37'} Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:03.529228 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:03.530550 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:03.531587 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:03.531587 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f957ac30-0f2b-4abf-89ac-4f6e64eaa46e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 404 len: 111 microversion: 2.1 time: 0.046674 Oct 16 01:05:03.531587 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 360/756] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:05:03.538193 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ef5e1d6c-b761-40ab-b207-dbc5076e1caa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '.version_select at 0x7f5806ecde50>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.559608 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ef5e1d6c-b761-40ab-b207-dbc5076e1caa tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152628030" status: 202 len: 0 microversion: 2.1 time: 0.025478 Oct 16 01:05:03.560190 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 397/757] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 16 01:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152628030 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:05:05.520351 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.521034 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.536532 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.537067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.537510 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.542250 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.542845 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.546487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.587921 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 HTTP/1.1 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:05.593355 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.595264 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'fee3d0df-6e99-43f2-91f7-eaf717c48f37'} Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:05.596150 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.597580 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.600472 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:05.601636 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-14db8f0d-52d5-44c1-8780-db2189797d97 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 404 len: 111 microversion: 2.1 time: 0.085082 Oct 16 01:05:05.602867 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 361/758] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:05 2022] DELETE /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:05.611616 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.612995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: fee3d0df-6e99-43f2-91f7-eaf717c48f37] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.620117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.620866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.621456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.622476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.623107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.623704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.643218 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 HTTP/1.1 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:05.645258 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.646599 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'fee3d0df-6e99-43f2-91f7-eaf717c48f37'} Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:05.647360 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. Oct 16 01:05:05.648568 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:05.651533 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance fee3d0df-6e99-43f2-91f7-eaf717c48f37 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:05.652637 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-deafcba5-3ae7-4940-b67e-581215933d0c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37" status: 404 len: 111 microversion: 2.1 time: 0.045728 Oct 16 01:05:05.656883 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 398/759] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/servers/fee3d0df-6e99-43f2-91f7-eaf717c48f37 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:06.813596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.814732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.821452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.821933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.822363 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.823061 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.823549 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.824018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.838578 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d HTTP/1.1 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:06.840531 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.841989 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'ffecdc47-2f1e-48ca-a824-f5a3be48730d'} Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:06.842821 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.844422 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.845646 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:06.845646 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3579322b-10d5-4d07-a7f2-580604496234 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 404 len: 111 microversion: 2.1 time: 0.032556 Oct 16 01:05:06.845646 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 362/760] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:06 2022] DELETE /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:06.851829 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.852452 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: ffecdc47-2f1e-48ca-a824-f5a3be48730d] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.859869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.860358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.860788 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.861762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.862327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.862845 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.878845 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d HTTP/1.1 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:06.880615 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.882007 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'ffecdc47-2f1e-48ca-a824-f5a3be48730d'} Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:06.882772 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. Oct 16 01:05:06.884422 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.885827 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance ffecdc47-2f1e-48ca-a824-f5a3be48730d could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:06.885827 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-80727f44-0758-4a8a-96a9-7aafd46c724d tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d" status: 404 len: 111 microversion: 2.1 time: 0.035007 Oct 16 01:05:06.885827 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 399/761] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/ffecdc47-2f1e-48ca-a824-f5a3be48730d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:05:06.892758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.893311 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.899666 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.900159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.900594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.901553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.902017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.902479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.917858 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 HTTP/1.1 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:06.919680 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.921409 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'b4434ad0-46fe-4731-affd-44c026f7f955'} Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:06.922297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.923572 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.924828 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:06.924828 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-406edf65-2ff1-4939-bf2e-5a7857bb4efe tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 404 len: 111 microversion: 2.1 time: 0.035112 Oct 16 01:05:06.924828 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 363/762] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:06 2022] DELETE /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:06.932310 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.933149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: b4434ad0-46fe-4731-affd-44c026f7f955] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.939620 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.940486 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.941198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.942091 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.942809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.943437 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.960747 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 HTTP/1.1 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:06.962450 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.963990 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'b4434ad0-46fe-4731-affd-44c026f7f955'} Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:06.964716 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. Oct 16 01:05:06.967126 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:06.970052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance b4434ad0-46fe-4731-affd-44c026f7f955 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:06.970052 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4bdb3729-1928-4b20-b4e7-9e0caa9ca8c4 tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955" status: 404 len: 111 microversion: 2.1 time: 0.036537 Oct 16 01:05:06.970052 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 400/763] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/b4434ad0-46fe-4731-affd-44c026f7f955 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:05:07.889598 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-680cb650-5886-41ff-827f-6c49c651c065 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Action: 'create', calling method: .version_select at 0x7f5806e87160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-449122427", "metadata": {"Type": "work"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-680cb650-5886-41ff-827f-6c49c651c065 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 121 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:07.907628 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-449122427", "metadata": {"Type": "work"}}} Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:05:07.909013 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-449122427', 'metadata': {'Type': 'work'}}}} Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi '#$%' Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:07.909845 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:05:07.911297 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:05:07.912641 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:05:07.912641 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.912641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-680cb650-5886-41ff-827f-6c49c651c065 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:07.912641 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-680cb650-5886-41ff-827f-6c49c651c065 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139886 Oct 16 01:05:07.912641 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 364/764] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 16 01:05:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:05:07.918944 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-958a9207-581f-44eb-b45d-a2b77344a6f1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Action: 'create', calling method: .version_select at 0x7f5806dcbca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-920982346", "metadata": {"Type": "work"}}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-958a9207-581f-44eb-b45d-a2b77344a6f1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 119 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:07.923656 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-920982346", "metadata": {"Type": "work"}}} Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: Oct 16 01:05:07.925261 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-920982346', 'metadata': {'Type': 'work'}}}} Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi '0' Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:07.926375 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:05:07.927914 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:05:07.929634 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:05:07.929634 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.929634 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-958a9207-581f-44eb-b45d-a2b77344a6f1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:07.929634 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-958a9207-581f-44eb-b45d-a2b77344a6f1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010031 Oct 16 01:05:07.929634 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 401/765] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 16 01:05:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:05:07.934104 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-44c42ad2-3512-43f6-b85c-e4973dbb1a85 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Action: 'create', calling method: .version_select at 0x7f5806e05940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-157630461", "metadata": {"Type": "work"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-44c42ad2-3512-43f6-b85c-e4973dbb1a85 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 118 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:07.939706 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-157630461", "metadata": {"Type": "work"}}} Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:05:07.941452 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-157630461', 'metadata': {'Type': 'work'}}}} Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi '' Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:07.942331 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:05:07.943860 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:05:07.945396 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:05:07.945396 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.945396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-44c42ad2-3512-43f6-b85c-e4973dbb1a85 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:07.945396 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-44c42ad2-3512-43f6-b85c-e4973dbb1a85 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010771 Oct 16 01:05:07.945396 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 365/766] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 16 01:05:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:05:07.950544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-215ee954-f9f4-4495-a3d1-9880cb2381e1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Calling method '.version_select at 0x7f5806d70310>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.980504 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-215ee954-f9f4-4495-a3d1-9880cb2381e1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] HTTP exception thrown: Volume tempest-invalid-1908009245 could not be found. Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-215ee954-f9f4-4495-a3d1-9880cb2381e1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1908009245 HTTP/1.1 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:07.982516 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Volume tempest-invalid-1908009245 could not be found. Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'tempest-invalid-1908009245'} Oct 16 01:05:07.983959 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1908009245 could not be found. (HTTP 404) (Request-ID: req-b1409f85-f9fc-4240-b696-1ea14c6595f4) Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.984759 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:05:07.985955 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1908009245 could not be found. Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:07.987082 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1908009245 could not be found. Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1908009245 could not be found. Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-215ee954-f9f4-4495-a3d1-9880cb2381e1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 404 to user: Volume tempest-invalid-1908009245 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-215ee954-f9f4-4495-a3d1-9880cb2381e1 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1908009245" status: 404 len: 99 microversion: 2.1 time: 0.039197 Oct 16 01:05:07.988233 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 402/767] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 16 01:05:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1908009245 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:05:07.995665 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c375a445-b0f4-47ea-a2ba-e4d5e5e94dd7 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003796 Oct 16 01:05:07.996159 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 366/768] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 16 01:05:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 16 01:05:08.004452 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7bae23be-96f6-436a-8d21-a0a8f151e49e tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003671 Oct 16 01:05:08.004980 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 403/769] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 16 01:05:08.012751 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-072b5d87-c153-4f27-8bb0-12279962f079 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Calling method '.version_select at 0x7f5806e24790>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.041149 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-072b5d87-c153-4f27-8bb0-12279962f079 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] HTTP exception thrown: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-072b5d87-c153-4f27-8bb0-12279962f079 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/os-volumes/69e05fba-03d9-4f93-adad-6f62b51ce0e8 HTTP/1.1 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:08.043112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '69e05fba-03d9-4f93-adad-6f62b51ce0e8'} Oct 16 01:05:08.044647 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. (HTTP 404) (Request-ID: req-82dda1fc-3fc6-4cf8-b43e-5ef384f63752) Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.045662 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:05:08.046828 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:05:08.047942 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-072b5d87-c153-4f27-8bb0-12279962f079 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 404 to user: Volume 69e05fba-03d9-4f93-adad-6f62b51ce0e8 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-072b5d87-c153-4f27-8bb0-12279962f079 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/69e05fba-03d9-4f93-adad-6f62b51ce0e8" status: 404 len: 109 microversion: 2.1 time: 0.035054 Oct 16 01:05:08.049093 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 367/770] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 16 01:05:08 2022] DELETE /compute/v2.1/os-volumes/69e05fba-03d9-4f93-adad-6f62b51ce0e8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:08.054711 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-276491ec-d73d-4e8a-bc32-0069784f7150 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Calling method '.version_select at 0x7f5806dcba60>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.083492 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-276491ec-d73d-4e8a-bc32-0069784f7150 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] HTTP exception thrown: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-276491ec-d73d-4e8a-bc32-0069784f7150 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Request method failure captured: Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/os-volumes/154aea56-000f-4d5c-8c8b-76a9a51fe975 HTTP/1.1 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1jDWH3eGSK8q69lt5BSe1EqL3CnHP9c6EQI07ism0lZOU9PV_kSQIIlCzlSQ8VWDz_zRUAE_HG09De_dSTu0Fo8Rq857xSyvX-eeLVd2_xv8TsbzXgUDEXTYyT_4VW7a2voRvZtkpMJEqnXIp6moUwpziu7gw-YQtdJeBilcYM-saw Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:08.085572 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a246375517e43c6ae7624c9d930e371", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a246375517e43c6ae7624c9d930e371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a246375517e43c6ae7624c9d930e371"}]}] Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 5a246375517e43c6ae7624c9d930e371 Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesNegativeTest-188180728 Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: bfe28d4ab9f947e3b8eab545b367eeef Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesNegativeTest-188180728-project Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '154aea56-000f-4d5c-8c8b-76a9a51fe975'} Oct 16 01:05:08.086884 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. (HTTP 404) (Request-ID: req-7fd20ae0-fefc-4a0f-a63b-da70e962405a) Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.087898 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:05:08.089075 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:05:08.090233 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-276491ec-d73d-4e8a-bc32-0069784f7150 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] Returning 404 to user: Volume 154aea56-000f-4d5c-8c8b-76a9a51fe975 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-276491ec-d73d-4e8a-bc32-0069784f7150 tempest-VolumesNegativeTest-188180728 tempest-VolumesNegativeTest-188180728-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/154aea56-000f-4d5c-8c8b-76a9a51fe975" status: 404 len: 109 microversion: 2.1 time: 0.036446 Oct 16 01:05:08.092396 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 404/771] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/os-volumes/154aea56-000f-4d5c-8c8b-76a9a51fe975 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:08.150310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.151708 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.158271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.158754 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.159188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.159893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.160348 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.160757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.175344 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 HTTP/1.1 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:05:08.177112 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.178525 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '511846b5-6613-4b20-8550-31b4067e1da2'} Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.179272 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.180456 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.183227 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.184104 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-16c91dbe-c942-4adf-8a5a-36aa1c55ee2c tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 404 len: 111 microversion: 2.1 time: 0.037544 Oct 16 01:05:08.184679 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 368/772] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:08 2022] DELETE /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:08.193500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.194127 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] [instance: 511846b5-6613-4b20-8550-31b4067e1da2] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.196305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:08.205027 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.205824 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.206275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.206995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.207449 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.207872 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.225121 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] HTTP exception thrown: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Request method failure captured: Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 HTTP/1.1 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1b7BwrDalBwbNnmVXuIe7RRkUa5WoVOd1aaJnS1O-qZRYdgcW4vRwmO7qIUHKz4ekMx5ZLZfiDnOll-sDt7CM69H42NNcmntvre1sKeyQfP8x7YONf-iLoX2r5A4zIjR3egtO18R9xDxurcCLGWAQKeLwJUaO9Ai6Aq0K9CP8H6-c4 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:08.227330 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94363b1b0a0d48229b3bef2b1b779d2e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94363b1b0a0d48229b3bef2b1b779d2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94363b1b0a0d48229b3bef2b1b779d2e"}]}] Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: 94363b1b0a0d48229b3bef2b1b779d2e Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1148295414 Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: 2da699bb0c51440593b8175d05869203 Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-AttachVolumeNegativeTest-1148295414-project Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.228724 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '511846b5-6613-4b20-8550-31b4067e1da2'} Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.229702 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. Oct 16 01:05:08.230890 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.232240 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] Returning 404 to user: Instance 511846b5-6613-4b20-8550-31b4067e1da2 could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.232240 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2e93dc68-3921-4be7-8ca0-1ff55d93c10e tempest-AttachVolumeNegativeTest-1148295414 tempest-AttachVolumeNegativeTest-1148295414-project] 10.222.0.13 "GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2" status: 404 len: 111 microversion: 2.1 time: 0.039921 Oct 16 01:05:08.232240 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 405/773] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/servers/511846b5-6613-4b20-8550-31b4067e1da2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:28.760318 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1503235561", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "4b44f4de-535e-4b34-b934-1c400eb581cd"}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:28.769407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:28.770060 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=38 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:28.822078 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] validate_networks() for [('4b44f4de-535e-4b34-b934-1c400eb581cd', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:05:29.186755 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:05:29.187178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:05:29.187646 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:05:29.188077 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:05:29.188483 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:05:29.197557 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.198063 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.198487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.199300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.199871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.200436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.219758 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Getting quotas for project e14769d9c5aa4e4e8a330169dd023ec1. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:29.224125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Getting quotas for user ae4d9e7a0dee453794b5c059de8776e6 and project e14769d9c5aa4e4e8a330169dd023ec1. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:29.236082 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:05:29.238823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:05:29.287755 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR oslo.messaging._drivers.impl_rabbit [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [4b762d08-2a2b-4c7c-a29d-bbc75e845c07] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 01:05:30.296062 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO oslo.messaging._drivers.impl_rabbit [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [4b762d08-2a2b-4c7c-a29d-bbc75e845c07] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54436. Oct 16 01:05:30.300942 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-494f627a-4e02-4544-a09f-e9d5992261ae tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544688 Oct 16 01:05:30.301799 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 369/774] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:05:30.313537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3ebd0d1e-c5aa-4375-95e2-440d2a22139f tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:30.314225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3ebd0d1e-c5aa-4375-95e2-440d2a22139f tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:30.318800 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:30.374154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3ebd0d1e-c5aa-4375-95e2-440d2a22139f tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:30.383236 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3ebd0d1e-c5aa-4375-95e2-440d2a22139f tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1214 microversion: 2.1 time: 0.074106 Oct 16 01:05:30.383865 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 406/775] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:30 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:31.407440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:31.409192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:31.416757 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.417509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.418032 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.419292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.419857 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.420344 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.487874 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:31.496915 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2d692b4a-ab51-47b5-ab3e-5b1cd89a43a1 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1274 microversion: 2.1 time: 0.094844 Oct 16 01:05:31.497589 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 370/776] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:31 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:32.519995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:32.520733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:32.527311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:32.527795 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:32.528226 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.528935 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:32.529411 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:32.529833 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.659581 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:32.667815 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-233ae7cb-06cf-4230-8489-5195080693fb tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.151744 Oct 16 01:05:32.668363 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 407/777] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:32 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:32.756086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f061ce2c-870f-4f8e-87c0-f74a450bb26b", "tag": "7c616362-f05a-4d26-854f-275270008749"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:32.767148 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:32.768463 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:32.768925 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.780766 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] Creating event network-changed:7c616362-f05a-4d26-854f-275270008749 for instance f061ce2c-870f-4f8e-87c0-f74a450bb26b on hv-cinder-maste Oct 16 01:05:32.785709 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-f5519321-1c7a-4144-848d-04395459c82d req-e0de35a8-0ff3-4798-8767-ecc53fab73de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Oct 16 01:05:32.786334 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 371/778] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:05:33.690894 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:33.691394 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:33.698407 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.698986 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.699449 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.700205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.700661 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.701187 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.867844 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:33.877720 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-9c69ad16-9d3d-4917-9fbe-310884e9219e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.190577 Oct 16 01:05:33.878654 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 408/779] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:33 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:34.902766 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:34.903458 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:34.910583 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:34.910999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:34.911424 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:34.912109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:34.912555 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:34.913037 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:35.089207 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:35.120414 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5c0e600d-c562-4bc0-ba02-5d504fac4ef0 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.221701 Oct 16 01:05:35.126563 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 372/780] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:34 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:36.162337 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:36.162985 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:36.170636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.170636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.171162 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:36.171968 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.172494 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.172975 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:36.318328 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:36.330786 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3cd92860-31fc-4494-863a-1846b8dbae90 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.172007 Oct 16 01:05:36.331652 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 409/781] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:36 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:37.360412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:37.361415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:37.369093 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.369589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.370030 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.370762 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.371222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.371646 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.502572 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:37.510614 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1c84b0b9-5c0c-4a93-9ac6-25d2dc5386c5 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.156977 Oct 16 01:05:37.511191 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 373/782] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:37 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:38.535699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:38.536318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:38.543118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:38.543608 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:38.544046 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:38.544735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:38.545227 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:38.545653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:38.681518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:38.689756 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6f3f2006-54cf-41bf-b6dd-0cf136a42f1c tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.158198 Oct 16 01:05:38.690343 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 410/783] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:38 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:39.106664 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f061ce2c-870f-4f8e-87c0-f74a450bb26b", "name": "network-vif-plugged", "status": "completed", "tag": "7c616362-f05a-4d26-854f-275270008749"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:39.116786 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:39.117468 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:39.117800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:39.129031 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] Creating event network-vif-plugged:7c616362-f05a-4d26-854f-275270008749 for instance f061ce2c-870f-4f8e-87c0-f74a450bb26b on hv-cinder-maste Oct 16 01:05:39.133924 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-7a4d7b6e-fc47-47f7-9ba2-9c7a1c5ed9a4 req-cfa86bb0-d574-4786-9bd1-58295f8df5b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031060 Oct 16 01:05:39.134581 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 374/784] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:39.715309 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:39.715859 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:39.723423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:39.724076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:39.724624 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:39.725350 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:39.725996 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:39.726432 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:39.862593 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:39.871433 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-72f962a7-7ba3-4174-bf89-c11f9f26e4da tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.160911 Oct 16 01:05:39.872221 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 411/785] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:39 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:40.900228 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.901293 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.906602 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:40.907303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:40.914920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:40.915414 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:40.915833 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:40.916523 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:40.917001 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:40.917420 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.059001 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:41.070810 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9d2dd788-7fd9-4edd-be07-ad304804bec7 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1314 microversion: 2.1 time: 0.171219 Oct 16 01:05:41.071634 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 375/786] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:40 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:42.101487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:42.102568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:42.105722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:42.115340 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.115821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.116261 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.116992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.117451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.117873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.252423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:42.260811 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-10c0c701-5c4c-4a87-8a5e-baefac4b563d tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1499 microversion: 2.1 time: 0.166475 Oct 16 01:05:42.261427 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 412/787] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:42 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:42.742014 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:42.742498 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:42.749182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.749663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.750095 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.750772 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.751226 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.751643 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.776489 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:42.856917 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a481b35c-b94f-4f4c-887d-2028c0895e49 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 204 len: 0 microversion: 2.1 time: 0.118588 Oct 16 01:05:42.857573 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 376/788] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:42 2022] DELETE /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:42.867329 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:42.867947 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:42.875485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.876017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.876630 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.877558 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.878138 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.878561 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.015739 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:43.027789 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-34bf4e92-198f-4d38-bb5e-908534a662ee tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1505 microversion: 2.1 time: 0.165775 Oct 16 01:05:43.028458 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 413/789] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:42 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:44.054365 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:44.055101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:44.062114 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.062590 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.063018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.063702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.064150 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.064586 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.203523 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:44.211610 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5ccba573-ab86-4a53-8eb7-ecf7a2040770 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1505 microversion: 2.1 time: 0.161695 Oct 16 01:05:44.212176 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 377/790] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:44 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:45.051709 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f061ce2c-870f-4f8e-87c0-f74a450bb26b", "name": "network-vif-deleted", "tag": "7c616362-f05a-4d26-854f-275270008749"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:45.062223 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.062704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.063154 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:45.074587 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] Creating event network-vif-deleted:7c616362-f05a-4d26-854f-275270008749 for instance f061ce2c-870f-4f8e-87c0-f74a450bb26b on hv-cinder-maste Oct 16 01:05:45.081024 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-3a67bfdc-9052-4dac-ac38-093bbb8b0923 req-e7876230-6f2c-462e-8683-e8981a06a724 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033045 Oct 16 01:05:45.081908 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 414/791] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:45.242926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:45.243525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:45.249979 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.250453 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.250883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:45.251525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.252101 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.252518 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:45.283837 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.284329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.284877 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:45.285319 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lazy-loading 'fault' on Instance uuid f061ce2c-870f-4f8e-87c0-f74a450bb26b {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:45.325093 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:45.332756 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3df9c8a0-4a5f-43fb-9cb2-42834a9d4cd3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 200 len: 1304 microversion: 2.1 time: 0.093765 Oct 16 01:05:45.333505 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 378/792] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:45 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:46.362332 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:46.363145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: f061ce2c-870f-4f8e-87c0-f74a450bb26b] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:46.369832 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.370310 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.370738 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.371422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.371868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.372284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.385661 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] HTTP exception thrown: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Request method failure captured: Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b HTTP/1.1 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1jWSAMeyEd_OhbYl0cvTnU6gc1B__R1gE3K_IZcUezH_G5mDqmu04JeWTT0KSBjpH6yCsvqYcGkuBS5eU1x-k0XKRn9HDSZIV65ejx34HpNxY7qg_ExXN4n18cBr_D99yglsX0HKcdUsNa2QGgChE7GBsvVIcMLKvUpyDb-tNfi3Dg Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: e14769d9c5aa4e4e8a330169dd023ec1 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesActionsTest-680853253 Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:05:46.387297 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e14769d9c5aa4e4e8a330169dd023ec1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e14769d9c5aa4e4e8a330169dd023ec1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e14769d9c5aa4e4e8a330169dd023ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e14769d9c5aa4e4e8a330169dd023ec1"}]}] Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesActionsTest-680853253 Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: e14769d9c5aa4e4e8a330169dd023ec1 Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesActionsTest-680853253 Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesActionsTest-680853253-project Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: ae4d9e7a0dee453794b5c059de8776e6 Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesActionsTest-680853253-project Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. Oct 16 01:05:46.388956 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': 'f061ce2c-870f-4f8e-87c0-f74a450bb26b'} Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:46.389942 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. Oct 16 01:05:46.391423 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:05:46.392763 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Returning 404 to user: Instance f061ce2c-870f-4f8e-87c0-f74a450bb26b could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:46.392763 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-801c96cf-0521-4476-83c3-1500e9bee318 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b" status: 404 len: 111 microversion: 2.1 time: 0.034299 Oct 16 01:05:46.393124 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 415/793] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:46 2022] GET /compute/v2.1/servers/f061ce2c-870f-4f8e-87c0-f74a450bb26b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:46.559381 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-880027788", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "4b44f4de-535e-4b34-b934-1c400eb581cd"}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:46.613503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] validate_networks() for [('4b44f4de-535e-4b34-b934-1c400eb581cd', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:05:46.966945 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:05:46.967535 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:05:46.968516 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:05:46.969133 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:05:46.969896 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:05:46.979805 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.980280 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.980707 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.981454 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.981899 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.982316 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.998771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Getting quotas for project e14769d9c5aa4e4e8a330169dd023ec1. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:47.003200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Getting quotas for user ae4d9e7a0dee453794b5c059de8776e6 and project e14769d9c5aa4e4e8a330169dd023ec1. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:47.014365 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:05:47.016645 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:05:47.061691 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-05d76c62-b6e4-4736-919f-6c0d1da7891e tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506175 Oct 16 01:05:47.062542 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 379/794] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:05:47.073406 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6df9d0b1-069f-4da1-a0ca-1586fb1e5aea tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:47.074020 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6df9d0b1-069f-4da1-a0ca-1586fb1e5aea tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:47.127580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6df9d0b1-069f-4da1-a0ca-1586fb1e5aea tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:47.134777 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6df9d0b1-069f-4da1-a0ca-1586fb1e5aea tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1213 microversion: 2.1 time: 0.065160 Oct 16 01:05:47.135331 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 416/795] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:47 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:48.158502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:48.159352 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:48.167680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:48.168647 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:48.169124 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.169983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:48.170422 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:48.171091 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.239503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:48.249968 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8dc72baf-06fe-47ab-ae04-1e61b2a1aae4 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1273 microversion: 2.1 time: 0.096125 Oct 16 01:05:48.261710 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 380/796] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:48 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:49.274750 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.275455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:49.282922 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.283407 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.283843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.284654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.285137 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.285559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.413863 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:49.421790 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4d21e376-b3d8-494b-8e24-e25831506392 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.150956 Oct 16 01:05:49.422359 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 417/797] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:49 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:49.501004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7656660e-b975-43ff-80df-6243e191494e", "tag": "bb1e8efa-63e0-4e70-a661-7d18c8c6dd84"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:49.511871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.512343 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.513054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.528145 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] Creating event network-changed:bb1e8efa-63e0-4e70-a661-7d18c8c6dd84 for instance 7656660e-b975-43ff-80df-6243e191494e on hv-cinder-maste Oct 16 01:05:49.533341 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-7cf165a3-8c77-4ede-9b8d-1d3f5d75715e req-b4d9fa43-524b-4207-b70c-2816f0262339 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036216 Oct 16 01:05:49.534015 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 381/798] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:50.449359 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:50.450478 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:50.461302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.462147 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.462831 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.463970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.464732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.465492 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.608123 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:50.615884 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-490eaa35-fa11-4ff2-8be1-3e548ded5688 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.173049 Oct 16 01:05:50.616451 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 418/799] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:50 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:51.641983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:51.643109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:51.650381 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:51.651053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:51.651581 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:51.652917 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:51.653418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:51.654046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.014663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:52.026759 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1ecb4054-b822-4d27-abc3-ad95706baa77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.389562 Oct 16 01:05:52.027648 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 382/800] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:51 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:53.056510 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:53.057492 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:53.068442 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:53.069316 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:53.070024 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:53.071139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:53.071892 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:53.072585 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:53.205843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:53.214027 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1a8fa866-22b6-49b8-a32b-2f7b6d089a77 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.164193 Oct 16 01:05:53.214622 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 419/801] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:53 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:54.237871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:54.238425 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:54.245020 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.245501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.245933 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:54.246620 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.247127 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.247539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:54.395298 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:54.403193 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1bf5ec76-9379-46cf-aa93-547d02aca65b tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.169636 Oct 16 01:05:54.403910 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 383/802] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:54 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:55.428224 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:55.429048 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:55.436234 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.436714 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.437177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.437868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.438318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.438737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.569080 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:55.577501 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-aa140548-36d9-4c7e-9bb8-1f61c782a735 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.154594 Oct 16 01:05:55.578088 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 420/803] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:55 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:56.601722 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:56.602473 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:56.609788 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:56.610272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:56.610705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:56.611428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:56.611883 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:56.612308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:56.751466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:56.763351 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-cfd729ea-c398-4e21-adcc-565d698cfc53 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.166265 Oct 16 01:05:56.764184 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 384/804] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:56 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:57.163257 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7656660e-b975-43ff-80df-6243e191494e", "name": "network-vif-plugged", "status": "completed", "tag": "bb1e8efa-63e0-4e70-a661-7d18c8c6dd84"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:57.170050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:57.174544 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.175056 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.175483 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.186735 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] Creating event network-vif-plugged:bb1e8efa-63e0-4e70-a661-7d18c8c6dd84 for instance 7656660e-b975-43ff-80df-6243e191494e on hv-cinder-maste Oct 16 01:05:57.191723 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-78d8c8f7-3bc6-4a86-a153-8fced7fb4f57 req-d4877aa9-f6e4-46e2-a8c4-d798d9fa76f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Oct 16 01:05:57.192326 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 421/805] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:05:57.794596 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:57.795229 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:57.797538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:57.798190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:57.804485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.804998 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.805419 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.806128 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.806574 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.806987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.936625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:57.944990 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c5c38ded-a4ab-4847-815c-84d5c44e1361 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1313 microversion: 2.1 time: 0.156309 Oct 16 01:05:57.945560 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 385/806] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:57 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:58.972721 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:58.973745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:58.983427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.984170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.984858 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.985925 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.986629 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.987278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.132405 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:59.140391 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-18211b03-ed19-4a80-9f03-ed8748f8bc4a tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1497 microversion: 2.1 time: 0.175410 Oct 16 01:05:59.140998 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 422/807] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:58 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:59.649367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:59.649945 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:59.651813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:59.657339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.657932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.658443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.659133 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.659591 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.660058 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.663373 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:59.688691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:59.766269 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fd5ee295-7e35-41d9-824f-bf2dc8f30819 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 204 len: 0 microversion: 2.1 time: 0.120795 Oct 16 01:05:59.766867 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 386/808] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:59 2022] DELETE /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:59.775603 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:59.776221 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:59.782762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.783383 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.783807 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.784516 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.784993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.785415 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.921205 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:59.929029 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-174661b7-79d1-4290-81c4-21388d2462a3 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1503 microversion: 2.1 time: 0.157301 Oct 16 01:05:59.929892 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 423/809] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:59 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:00.952385 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:00.953013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:00.959402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:00.959885 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:00.960310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:00.961038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:00.961497 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:00.961904 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:01.095731 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:01.103527 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-98f53f95-3b93-4357-837b-6d4c4be8ad91 tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1503 microversion: 2.1 time: 0.155616 Oct 16 01:06:01.104090 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 387/810] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:00 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:01.862695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7656660e-b975-43ff-80df-6243e191494e", "name": "network-vif-deleted", "tag": "bb1e8efa-63e0-4e70-a661-7d18c8c6dd84"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:01.867834 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=42 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:01.874717 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:01.875235 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:01.875782 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:01.879876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=85 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:01.888406 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] Creating event network-vif-deleted:bb1e8efa-63e0-4e70-a661-7d18c8c6dd84 for instance 7656660e-b975-43ff-80df-6243e191494e on hv-cinder-maste Oct 16 01:06:01.893942 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-e9fd9ca7-5f5f-44b4-ae09-29de19147fd4 req-8f391314-0d7d-4342-b252-08909a98c18d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035125 Oct 16 01:06:01.894614 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 424/811] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:02.130742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:02.131663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:02.140891 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:02.141360 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:02.141842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:02.142533 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:02.142983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:02.143408 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:02.174017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:02.174493 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:02.174929 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:02.175369 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lazy-loading 'fault' on Instance uuid 7656660e-b975-43ff-80df-6243e191494e {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:02.216364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4d9e7a0dee453794b5c059de8776e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14769d9c5aa4e4e8a330169dd023ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:02.224788 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6ed9f757-4775-4460-b028-9f0028c94abc tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 200 len: 1303 microversion: 2.1 time: 0.100170 Oct 16 01:06:02.225491 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 388/812] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:02 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:03.252087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:03.252782 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] [instance: 7656660e-b975-43ff-80df-6243e191494e] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:03.259151 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:03.259635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:03.260067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:03.260760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:03.261236 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:03.261641 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:03.277482 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.wsgi [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] HTTP exception thrown: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Request method failure captured: Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: request: GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e HTTP/1.1 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept: application/json Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Accept-Encoding: identity Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Connection: close Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Length: 0 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Content-Type: application/json Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Host: 10.222.0.13 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: Openstack-System-Scope: None Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Auth-Token: gAAAAABjS1jWSAMeyEd_OhbYl0cvTnU6gc1B__R1gE3K_IZcUezH_G5mDqmu04JeWTT0KSBjpH6yCsvqYcGkuBS5eU1x-k0XKRn9HDSZIV65ejx34HpNxY7qg_ExXN4n18cBr_D99yglsX0HKcdUsNa2QGgChE7GBsvVIcMLKvUpyDb-tNfi3Dg Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Id: None Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Domain-Name: None Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Identity-Status: Confirmed Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Is-Admin-Project: True Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Id: default Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Domain-Name: Default Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Id: e14769d9c5aa4e4e8a330169dd023ec1 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Project-Name: tempest-VolumesActionsTest-680853253 Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Role: member,reader Oct 16 01:06:03.279099 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Roles: member,reader Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e14769d9c5aa4e4e8a330169dd023ec1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e14769d9c5aa4e4e8a330169dd023ec1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e14769d9c5aa4e4e8a330169dd023ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e14769d9c5aa4e4e8a330169dd023ec1"}]}] Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant: tempest-VolumesActionsTest-680853253 Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Id: e14769d9c5aa4e4e8a330169dd023ec1 Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-Tenant-Name: tempest-VolumesActionsTest-680853253 Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User: tempest-VolumesActionsTest-680853253-project Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Id: default Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Domain-Name: Default Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Id: ae4d9e7a0dee453794b5c059de8776e6 Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: X-User-Name: tempest-VolumesActionsTest-680853253-project Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: method: > Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: exception: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. Oct 16 01:06:03.280878 dv-cinder-master-3-smb devstack@n-api.service[118977]: action_args: {'id': '7656660e-b975-43ff-80df-6243e191494e'} Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:03.281773 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. Oct 16 01:06:03.283347 dv-cinder-master-3-smb devstack@n-api.service[118977]: ERROR nova.api.openstack.wsgi Oct 16 01:06:03.284690 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] Returning 404 to user: Instance 7656660e-b975-43ff-80df-6243e191494e could not be found. {{(pid=118977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:03.284690 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a1b01b90-8e63-49d9-89ef-332e1e6c06ef tempest-VolumesActionsTest-680853253 tempest-VolumesActionsTest-680853253-project] 10.222.0.13 "GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e" status: 404 len: 111 microversion: 2.1 time: 0.034932 Oct 16 01:06:03.284690 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 425/813] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:03 2022] GET /compute/v2.1/servers/7656660e-b975-43ff-80df-6243e191494e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:15.427501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-776846756", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "7ba9d17d-d55a-4345-a42f-fad6849cda16"}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:15.447894 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:15.448859 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:15.673306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] validate_networks() for [('7ba9d17d-d55a-4345-a42f-fad6849cda16', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:06:16.080231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:06:16.080895 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:06:16.081575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:06:16.082184 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:06:16.082849 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:06:16.097103 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.097672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.098164 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.098980 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.099492 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.099970 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.116529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Getting quotas for project 6eb6fce9d1af4831b9766b5221e83a39. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:16.120870 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Getting quotas for user 91b45f14af1e45a491ceed5b26a353b3 and project 6eb6fce9d1af4831b9766b5221e83a39. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:16.131860 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:06:16.134241 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:06:16.181482 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-88049aea-33ba-4abb-bb23-5e3363e5cc20 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757867 Oct 16 01:06:16.188535 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 389/814] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:06:16.193997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8ad1cbed-db89-498d-b3ad-ddb7190d1330 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:16.194625 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8ad1cbed-db89-498d-b3ad-ddb7190d1330 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:16.197358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:16.198164 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:16.348692 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8ad1cbed-db89-498d-b3ad-ddb7190d1330 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.358040 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8ad1cbed-db89-498d-b3ad-ddb7190d1330 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1218 microversion: 2.1 time: 0.167899 Oct 16 01:06:16.359167 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 426/815] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:16 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:17.381836 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.382608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.392303 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.393338 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.394017 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.394926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.395563 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.396206 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.467023 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.475853 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9cacec74-0f24-470b-ab22-99b5a31422ae tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1278 microversion: 2.1 time: 0.098330 Oct 16 01:06:17.477108 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 390/816] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:18.501745 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:18.503488 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:18.511487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.512062 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.512577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.513355 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.514078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.514704 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.818554 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:18.828540 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-395e8860-40ac-4f3f-81f6-e2d1116cf5c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.331848 Oct 16 01:06:18.829235 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 427/817] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:18 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:19.076588 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a94fad-c4f4-4188-9268-954644d39931", "tag": "5d11570e-bacc-46ff-a822-247ec1312a26"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:19.088977 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.089766 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.090440 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:19.103156 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] Creating event network-changed:5d11570e-bacc-46ff-a822-247ec1312a26 for instance 89a94fad-c4f4-4188-9268-954644d39931 on hv-cinder-maste Oct 16 01:06:19.110865 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-8a898d1a-9ce5-420a-9b37-95b32c2c13e4 req-173eb18a-741c-4f3b-85f8-dab134a5f4ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040153 Oct 16 01:06:19.111954 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 391/818] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:19.858007 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:19.858877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:19.865599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.866220 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.866723 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:19.867423 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.867900 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.868321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:19.999809 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:20.007526 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6a124641-06e8-4d29-ab76-39d7a9e60217 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.153379 Oct 16 01:06:20.008150 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 428/819] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:19 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:21.035421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:21.036089 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.042793 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.043376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.043806 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.044501 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.045393 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.045616 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.189873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.197980 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-dc764cb8-5719-4371-ba1d-39f3c5245218 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.167301 Oct 16 01:06:21.198576 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 392/820] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:21 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:22.226305 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:22.227388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:22.238443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.239420 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.240130 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:22.241472 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.242307 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.243344 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:22.446895 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:22.455689 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-91d66818-7436-44a9-b9aa-29029ec77dc0 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.236144 Oct 16 01:06:22.456586 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 429/821] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:22 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:23.479871 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:23.480529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:23.487391 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.487873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.488306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.489045 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.489499 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.489918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.624872 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:23.633443 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-59d4e100-2fe1-47e4-a5b6-20aebad6d7ab tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.157921 Oct 16 01:06:23.634030 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 393/822] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:23 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:24.658717 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:24.659499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:24.669079 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:24.669737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:24.670318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.671089 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:24.671483 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:24.671902 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.817102 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:24.826201 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-49f6cbab-499f-4c80-a676-0ba635c34812 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.172600 Oct 16 01:06:24.826763 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 430/823] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:24 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:25.300320 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a94fad-c4f4-4188-9268-954644d39931", "name": "network-vif-plugged", "status": "completed", "tag": "5d11570e-bacc-46ff-a822-247ec1312a26"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:25.306215 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:06:25.306361 dv-cinder-master-3-smb devstack@n-api.service[118976]: Sun Oct 16 01:06:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Oct 16 01:06:25.313567 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.314046 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.314496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.325365 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] Creating event network-vif-plugged:5d11570e-bacc-46ff-a822-247ec1312a26 for instance 89a94fad-c4f4-4188-9268-954644d39931 on hv-cinder-maste Oct 16 01:06:25.329986 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-cb9596c8-e6e0-4feb-bbfe-b58afebed3e4 req-668d0022-8f8e-40cd-affa-9d362dd87950 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Oct 16 01:06:25.330601 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 394/824] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:25.853778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:25.854951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.865830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.866646 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.867349 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.868476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.869379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.869991 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.004926 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.012751 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1445ff77-15cc-4ecf-8cbd-c6feee6ecd5c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.166330 Oct 16 01:06:26.013336 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 431/825] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:25 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:27.032570 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.033370 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.038011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:27.038703 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:27.046264 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.046755 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.047182 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:27.047865 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.048313 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.048727 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:27.189456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:27.198144 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-116467da-2898-4592-b7f8-38e9a3629dbc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1318 microversion: 2.1 time: 0.166478 Oct 16 01:06:27.198717 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 395/826] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:27 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:28.222558 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:28.223172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:28.225463 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:28.231470 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.231970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.232440 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.233212 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.233682 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.234105 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.460265 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:28.468468 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-1cc800a8-f70a-445b-8164-77c252d99cb4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1506 microversion: 2.1 time: 0.249951 Oct 16 01:06:28.469090 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 432/827] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:28 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:45.073346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4", "device": "/dev/sdb"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:45.076597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:45.079364 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:45.080194 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=30 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:45.088628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.089542 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.090222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:45.092461 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.093189 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.093834 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:45.394210 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-99b6223e-daa6-46eb-b7cb-3615a87c5234 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "POST /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327039 Oct 16 01:06:45.400293 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 396/828] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:06:45 2022] POST /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:46.713158 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2de0afaf-fd35-4264-bb2c-de700abe5c38 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'create', calling method: .version_select at 0x7f5806f14040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-170547242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAM9AKtpoPc/IbCaEITG1Z+mgqkU9xI3bcN6EhKj3csua2NBWOIJy0hwr49dxV7nrIU35jmXg7EueKo03dwhPre4I7Nzoam98wtUitpgGu0+Yj0GJAQ5OKRdh7RtAnuKA=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:46.719164 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=16 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:46.719868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=36 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:46.731830 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-2de0afaf-fd35-4264-bb2c-de700abe5c38 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Getting quotas for project 7f2d2934c1834e02a6568c67cea56be5. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:46.736129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-2de0afaf-fd35-4264-bb2c-de700abe5c38 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Getting quotas for user 0ba011221c4d4f5aa17d63bec4762c42 and project 7f2d2934c1834e02a6568c67cea56be5. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:46.760724 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2de0afaf-fd35-4264-bb2c-de700abe5c38 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051400 Oct 16 01:06:46.761391 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 433/829] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:46.813382 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1793046487", "imageRef": "2ebfa087-2e6a-40f9-ae76-2241d05849a4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-170547242", "networks": [{"uuid": "164ee3da-cc2c-4370-b74e-f0d9fb03a6fe"}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:46.876767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] validate_networks() for [('164ee3da-cc2c-4370-b74e-f0d9fb03a6fe', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:06:47.267911 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:06:47.268468 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:06:47.269688 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:06:47.270249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:06:47.270859 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:06:47.285282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:47.285984 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:47.286417 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:47.287134 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:47.287585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:47.287999 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:47.307816 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Getting quotas for project 7f2d2934c1834e02a6568c67cea56be5. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:47.312113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Getting quotas for user 0ba011221c4d4f5aa17d63bec4762c42 and project 7f2d2934c1834e02a6568c67cea56be5. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:47.323072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:06:47.325519 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2ebfa087-2e6a-40f9-ae76-2241d05849a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:06:47.379990 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b5d2e9d1-22f8-4795-aa78-5193b67036ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571526 Oct 16 01:06:47.380796 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 397/830] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:06:47.392190 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6043cee1-352c-46bf-8cf9-c9cfe621b011 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:47.392884 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6043cee1-352c-46bf-8cf9-c9cfe621b011 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:47.446565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6043cee1-352c-46bf-8cf9-c9cfe621b011 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:47.453805 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6043cee1-352c-46bf-8cf9-c9cfe621b011 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1258 microversion: 2.1 time: 0.065812 Oct 16 01:06:47.454333 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 434/831] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:47 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:48.390902 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4", "create_info": {"type": "qcow2", "new_file": "volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.1176c346-0e63-41e6-8c68-115d40963a74.vhdx", "snapshot_id": "1176c346-0e63-41e6-8c68-115d40963a74"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:48.399832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=118976) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 16 01:06:48.400277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.400742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.401193 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.439985 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.440475 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.440924 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.464403 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-09a81027-62df-465a-97b3-b059a22d8d9d req-e0fe4b57-f0b7-44de-bc69-e5ddbf35f9f3 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.190088 Oct 16 01:06:48.465024 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 398/832] 10.222.0.43 () {64 vars in 1326 bytes} [Sun Oct 16 01:06:48 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:06:48.476450 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:48.477112 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:48.484935 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.485427 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.485866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.486563 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.487021 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.487443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.548730 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:48.557433 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ff49bf24-c572-46b3-a519-7dbb301bafa2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1310 microversion: 2.1 time: 0.084951 Oct 16 01:06:48.558088 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 435/833] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:48 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:49.580817 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:49.581574 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:49.588132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:49.588618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:49.589080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:49.589772 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:49.590220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:49.590641 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:49.651742 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:49.659758 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7c108b40-8d56-4838-ab8d-833d4234c3c5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1316 microversion: 2.1 time: 0.083743 Oct 16 01:06:49.660308 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 399/834] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:49 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:50.683599 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:50.684695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:50.692764 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:50.693418 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:50.693946 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:50.695182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:50.695702 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:50.696344 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:50.832242 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:50.841035 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6f3a2bdc-8b09-4114-9446-a11de4cddbeb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.161481 Oct 16 01:06:50.841743 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 436/835] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:50 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:51.866651 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:51.868155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:51.878083 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:51.878887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:51.879502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:51.880292 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:51.881219 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:51.881642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:52.018435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:52.027535 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fae5cb06-b5e7-4ce4-a21f-b29a6b30a31c tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.165722 Oct 16 01:06:52.028769 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 400/836] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:51 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:53.053263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:53.054720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:53.062256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:53.063077 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:53.063951 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:53.065038 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:53.065611 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:53.066138 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:53.224088 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:53.231909 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-76d2d143-76a9-4789-a565-ddf13a0bcabd tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.183530 Oct 16 01:06:53.232486 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 437/837] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:53 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:54.256480 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:54.257117 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:54.264509 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:54.265035 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:54.265469 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:54.266174 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:54.266627 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:54.267049 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:54.413031 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:54.422168 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b4c94d27-5537-4c5b-8165-27119904f614 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.169931 Oct 16 01:06:54.422757 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 401/838] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:54 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:55.444973 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:55.445558 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:55.452063 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:55.452587 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:55.453063 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:55.453853 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:55.454280 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:55.454699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:55.590146 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:55.598612 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a5b9856f-b0cd-43f1-b730-ea52369d6c9a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.157598 Oct 16 01:06:55.600003 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 438/839] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:55 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:56.629236 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:56.630040 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:56.636887 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:56.637383 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:56.637820 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:56.638527 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:56.638986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:56.639410 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:56.784866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:56.794156 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-794fbb78-4423-43c4-9ec7-a92509510720 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.168811 Oct 16 01:06:56.794707 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 402/840] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:56 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:57.817967 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:57.818652 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:57.821437 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:57.828017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:57.828135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:57.828588 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:57.829319 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:57.829779 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:57.830200 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:57.973862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:57.979564 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-99461db4-464f-4937-a675-7a349491ec8e tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.165528 Oct 16 01:06:57.997028 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 439/841] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:57 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:59.008349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:59.009053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:59.011294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:59.012779 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=4 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:59.019836 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:59.020332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:59.020825 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:59.021611 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:59.022051 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:59.022506 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:59.160550 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:59.168416 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-fe182afb-7f37-4476-96e2-41f29ffd8b72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.164515 Oct 16 01:06:59.169028 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 403/842] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:59 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:00.196049 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:00.196878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:00.203685 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:00.204170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:00.204604 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:00.205338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:00.205797 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:00.206229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:00.343564 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:00.351438 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-f23fbb06-2a97-4d58-b3c2-ec98b198197f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.162686 Oct 16 01:07:00.352007 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 440/843] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:00 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:01.375295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:01.375901 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:01.382672 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:01.383154 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:01.383584 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:01.384274 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:01.384725 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:01.385178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:01.516918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:01.528919 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c97b1a10-86bc-44b2-a825-0234f74e058f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.157266 Oct 16 01:07:01.529726 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 404/844] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:01 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:02.551656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:02.552270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:02.558806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:02.559422 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:02.559919 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:02.560722 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:02.561281 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:02.561796 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:02.691031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:02.698906 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a4a446fa-b09f-4d1f-b804-d8bc5cf222e2 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.151131 Oct 16 01:07:02.699451 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 441/845] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:02 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:03.272952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:03.282662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:03.283763 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:03.284197 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:03.295154 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] Creating event network-changed:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:07:03.300257 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-7a1b5652-c3d7-4b13-bf0d-bdce22fa1fe1 req-664239b4-c8ee-42b2-8b52-5ec2c9c3e045 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090488 Oct 16 01:07:03.301036 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 405/846] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:03.722594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:03.723145 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:03.729941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:03.730429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:03.730866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:03.731562 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:03.732083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:03.732509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:03.863531 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:03.871264 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-23b3dcc3-07a7-4d4a-893e-c84e3727f9b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.153155 Oct 16 01:07:03.871801 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 442/847] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:03 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:04.889350 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4", "create_info": {"type": "qcow2", "new_file": "volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.9a6f1dca-d959-43c6-8c7c-88d5ce901beb.vhdx", "snapshot_id": "9a6f1dca-d959-43c6-8c7c-88d5ce901beb"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:04.892903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.893464 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.893972 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:04.894970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:04.895579 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:04.902173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.902653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.903083 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:04.903272 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.903771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.903870 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.904218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.904434 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:04.904636 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:04.918233 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-dbcab896-97de-4aac-a33a-103eff978861 req-0d2c5661-8446-49e6-9311-48a8af1e6d96 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.082393 Oct 16 01:07:04.918833 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 406/848] 10.222.0.43 () {64 vars in 1326 bytes} [Sun Oct 16 01:07:04 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:07:05.037752 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:05.045662 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6181e425-4a6d-4171-81ef-2f085ad2a183 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.154602 Oct 16 01:07:05.046227 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 443/849] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:04 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:06.079418 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:06.080301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:06.089006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:06.089615 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:06.090166 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:06.091039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:06.091612 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:06.092147 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:06.229251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:06.241054 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6689b8e0-4714-47b0-bdb2-53fb793ad9ee tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.168477 Oct 16 01:07:06.241725 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 407/850] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:06 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:07.270272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:07.271302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:07.282163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:07.282659 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:07.283095 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:07.283786 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:07.284245 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:07.284668 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:07.422862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:07.431056 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ad141f9c-fd51-4e7d-8749-66728deb2c0b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.167501 Oct 16 01:07:07.431880 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 444/851] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:07 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:08.458462 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:08.459378 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:08.470814 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:08.471285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:08.471712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:08.472402 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:08.472882 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:08.473295 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:08.769245 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:08.777363 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-23347132-7e23-4e10-8b08-9db03dd5004d tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.325491 Oct 16 01:07:08.777951 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 408/852] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:08 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:09.640012 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "name": "network-vif-plugged", "status": "completed", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:09.649869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:09.650358 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:09.650831 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:09.661509 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] Creating event network-vif-plugged:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:07:09.666721 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-63544840-1ea1-4fe8-b06c-126ecf40dba0 req-83863f24-0802-43a5-b6f0-a41324e15c42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093375 Oct 16 01:07:09.667314 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 445/853] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:09.801822 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:09.802413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:09.809210 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:09.809702 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:09.810132 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:09.810823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:09.811276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:09.811695 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:09.941515 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:09.949656 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ff08efeb-0f5f-4ab2-ad48-21bf7f826709 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.152665 Oct 16 01:07:09.950212 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 409/854] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:09 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:10.978379 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:10.979666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:10.990872 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.991685 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.992388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:10.993568 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.994333 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.995042 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:11.350042 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:11.357813 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2fbccf86-6910-407d-a117-adf6a54b5024 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.387108 Oct 16 01:07:11.358384 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 446/855] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:10 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:12.382455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:12.383076 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:12.390013 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:12.390502 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:12.390934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:12.391628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:12.392085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:12.392512 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:12.520437 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:12.528827 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7a1b382c-a06e-4ce1-93d6-8b3bab302bf3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.150442 Oct 16 01:07:12.529432 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 410/856] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:12 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:13.554361 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:13.555050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:13.563039 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:13.563623 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:13.564146 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:13.565017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:13.565559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:13.566068 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:13.701486 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:13.709226 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7414876c-5f5e-4d81-92cf-b0d0aaafcd71 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1358 microversion: 2.1 time: 0.160461 Oct 16 01:07:13.709846 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 447/857] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:13 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:14.387329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4", "create_info": {"type": "qcow2", "new_file": "volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.08736e76-244e-4f49-8edc-819b2938ba99.vhdx", "snapshot_id": "08736e76-244e-4f49-8edc-819b2938ba99"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:14.390680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.391183 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.391613 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:14.400436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.400926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.401358 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:14.414729 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-f90b3dde-8799-4f67-94d4-1260e3c4ddb0 req-443e2cd4-9801-4364-b55f-069ea70b0211 admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.083138 Oct 16 01:07:14.415296 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 411/858] 10.222.0.43 () {64 vars in 1326 bytes} [Sun Oct 16 01:07:14 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:07:14.735885 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:14.736758 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:14.747187 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.747798 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.748396 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:14.749492 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.750118 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.750677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:14.893565 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:14.901986 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a8ed7cae-50a2-4b4c-ba85-c9a9408d1ea3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1548 microversion: 2.1 time: 0.172778 Oct 16 01:07:14.902641 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 448/859] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:14 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:14.924944 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:14.925648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:14.932067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.932555 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.933027 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:14.933720 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:14.934176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:14.934603 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:15.065589 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:15.074142 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-39081236-b089-420d-9fc1-3bb15dbf4b2a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1548 microversion: 2.1 time: 0.153513 Oct 16 01:07:15.074711 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 412/860] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:14 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:15.099382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:15.104376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:15.105222 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Searching by: {'deleted': False, 'project_id': '7f2d2934c1834e02a6568c67cea56be5'} {{(pid=118977) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:07:15.112225 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:15.112717 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:15.113254 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:15.114039 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:15.114494 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:15.114921 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:15.203244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.multi_cell_list [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118977) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:07:15.296220 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-be86994f-8e84-4b2f-b8ce-e28af497644a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203327 Oct 16 01:07:15.296719 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 449/861] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 16 01:07:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:15.308654 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:15.309299 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:15.311271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:15.316773 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:15.317421 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:15.317866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:15.318554 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:15.319009 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:15.319412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:15.322705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:15.465310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:15.473993 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-78260efb-7654-42de-9be1-50f73441bcb9 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1548 microversion: 2.1 time: 0.169255 Oct 16 01:07:15.474548 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 413/862] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:15 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:17.086656 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5a1415-4c1a-4258-9edf-5ed281591043"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:17.088999 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:17.091456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:17.097397 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.097879 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.098293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.098998 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.099443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.099857 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.103172 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=89 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:17.374467 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-aa22fc61-0fcc-4cd3-8480-5f89012855d4 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291884 Oct 16 01:07:17.375075 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 450/863] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:07:17 2022] POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:18.507815 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:18.511170 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:18.511650 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:18.512084 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:18.520406 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:18.520867 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:18.521324 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:18.535066 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-99debfb0-657c-46d4-ae9f-afc6e72cedb8 req-aaebf673-2454-47c6-bc91-573f7914f5bf admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/1176c346-0e63-41e6-8c68-115d40963a74?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.1176c346-0e63-41e6-8c68-115d40963a74.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078691 Oct 16 01:07:18.535629 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 414/864] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:07:18 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/1176c346-0e63-41e6-8c68-115d40963a74?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.1176c346-0e63-41e6-8c68-115d40963a74.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:07:19.684710 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:19.685468 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:19.692245 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:19.692731 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:19.693198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:19.693895 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:19.694352 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:19.694772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:19.829353 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:19.838297 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7cd8a4c8-1c55-44e7-ac98-8492a7d5e098 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1594 microversion: 2.1 time: 0.158376 Oct 16 01:07:19.838872 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 451/865] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:19 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:21.573018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:21.583970 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:21.584937 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:21.585468 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:21.600457 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] Creating event network-changed:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:07:21.606015 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-44a8ccdc-5c5e-4ab3-97eb-35afd57270a8 req-6f1c71b7-6c09-4600-9781-75916051f533 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100635 Oct 16 01:07:21.606634 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 415/866] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:22.637762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1195464529"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:22.638218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:22.644924 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:22.645597 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:22.646256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:22.647106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:22.647567 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:22.648010 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:22.722086 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:22.725331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:22.725813 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:22.726240 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:22.734784 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:22.735251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:22.735689 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:22.749726 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-eb9d15ac-d310-4c2b-875d-d3a50797cc4a req-34cd5d4a-e4b5-4b45-a725-879c9462d0e6 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/08736e76-244e-4f49-8edc-819b2938ba99?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.08736e76-244e-4f49-8edc-819b2938ba99.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079348 Oct 16 01:07:22.750265 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 416/867] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:07:22 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/08736e76-244e-4f49-8edc-819b2938ba99?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.08736e76-244e-4f49-8edc-819b2938ba99.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:07:22.778853 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.network.security_group_api [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Adding security group bc6ffcb3-709f-4eb6-b49b-538b7947f91f to port 55069e9b-0f47-4ba8-afa4-a1a621b342ed Oct 16 01:07:23.146175 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-53cf4197-92e7-4c77-8885-d3f0acf0e8b3 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action" status: 202 len: 0 microversion: 2.1 time: 0.518239 Oct 16 01:07:23.146995 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 452/868] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:07:22 2022] POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:07:23.156096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:23.157069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:23.163801 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:23.167039 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:23.167594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:23.168443 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:23.168983 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:23.169549 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:23.318610 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:23.327846 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ab26adff-ce30-4ffe-8870-ee4d7ebe3028 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1760 microversion: 2.1 time: 0.175934 Oct 16 01:07:23.328543 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 417/869] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:23 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:23.621532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:23.631367 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:23.631847 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:23.632275 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:23.643683 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] Creating event network-changed:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:07:23.649321 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-a9959fd3-c3e1-422c-8dac-8e9612320c51 req-050c4475-96cc-406c-8f29-dc8c1bde96cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032064 Oct 16 01:07:23.649911 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 453/870] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:25.917767 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:25.921155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:25.921637 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:25.922073 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:25.930760 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:25.931231 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:25.931658 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:25.946189 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-43c978e8-1c3a-48da-9477-73ca3a4f74d2 req-87701d71-1a52-4c28-8058-5d3a54ded19b admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/9a6f1dca-d959-43c6-8c7c-88d5ce901beb?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.9a6f1dca-d959-43c6-8c7c-88d5ce901beb.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080413 Oct 16 01:07:25.946763 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 418/871] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:07:25 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/9a6f1dca-d959-43c6-8c7c-88d5ce901beb?delete_info=%7B%22file_to_merge%22:%20%22volume-51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4.9a6f1dca-d959-43c6-8c7c-88d5ce901beb.vhdx%22,%20%22volume_id%22:%20%2251e067a1-cc3a-4fc1-9af8-6ecfae82f9d4%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:07:28.876125 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:28.876699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:28.879163 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:28.885069 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:28.885491 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:28.885928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:28.886622 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:28.887078 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:28.887500 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:28.972632 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lazy-loading 'services' on Instance uuid 89a94fad-c4f4-4188-9268-954644d39931 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:07:29.056610 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8ecb5241-5039-4f25-95d7-51842c5e836f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931/os-volume_attachments/51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4" status: 202 len: 0 microversion: 2.1 time: 0.184560 Oct 16 01:07:29.057339 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 454/872] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:07:28 2022] DELETE /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931/os-volume_attachments/51e067a1-cc3a-4fc1-9af8-6ecfae82f9d4 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:30.186054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:30.186657 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:30.193631 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:30.194204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:30.194644 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:30.195329 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:30.195800 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:30.196210 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:30.221847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Going to try to terminate instance {{(pid=118976) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:07:30.307209 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-0abc664a-1f08-4439-bcf1-46fb376dc3c3 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 204 len: 0 microversion: 2.1 time: 0.125488 Oct 16 01:07:30.307791 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 419/873] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:07:30 2022] DELETE /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:07:30.319455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:30.320161 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:30.326865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:30.327346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:30.327775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:30.328461 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:30.328955 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:30.329377 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:30.464990 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:30.473597 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-29362e9f-8c49-4656-ae51-a91e05b97d64 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1512 microversion: 2.1 time: 0.160691 Oct 16 01:07:30.474173 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 455/874] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:30 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:31.502412 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:31.503467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:31.511456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:31.511943 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:31.512378 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:31.513111 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:31.513562 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:31.513987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:31.658774 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:31.666898 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b83658f3-81f3-4000-9928-16888d920a72 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1512 microversion: 2.1 time: 0.171836 Oct 16 01:07:31.667456 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 420/875] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:31 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:32.694175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:32.694777 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:32.701653 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:32.702136 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:32.702577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:32.703263 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:32.703718 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:32.704142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:32.846052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:32.855689 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7e3efb17-d7a8-476f-80fc-50545b45a513 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1512 microversion: 2.1 time: 0.168129 Oct 16 01:07:32.856255 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 456/876] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:32 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:33.883325 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:33.884420 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:33.896356 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:33.897222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:33.897842 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:33.898520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:33.898968 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:33.899389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:34.031540 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:34.039682 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f8ebbdc9-316f-40f9-bb37-b2790fc1069e tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1512 microversion: 2.1 time: 0.163304 Oct 16 01:07:34.040244 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 421/877] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:33 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:35.064031 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:35.064713 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:35.071997 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:35.072416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:35.072862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:35.073581 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:35.074034 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:35.074459 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:35.206084 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:35.213894 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b59fdfc1-1e0a-4f07-860b-9707484ea09d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1512 microversion: 2.1 time: 0.153978 Oct 16 01:07:35.214465 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 457/878] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:35 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:36.071270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a94fad-c4f4-4188-9268-954644d39931", "name": "network-vif-deleted", "tag": "5d11570e-bacc-46ff-a822-247ec1312a26"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:36.076681 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=10 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:36.082564 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.083033 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.083467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.096688 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] Creating event network-vif-deleted:5d11570e-bacc-46ff-a822-247ec1312a26 for instance 89a94fad-c4f4-4188-9268-954644d39931 on hv-cinder-maste Oct 16 01:07:36.101630 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-e34cfa70-a019-44c7-8720-66c163a59934 req-d484b613-b0ec-404a-92db-695c2ba60789 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Oct 16 01:07:36.102285 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 422/879] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:36.238279 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:36.238931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:36.246613 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.247108 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.247532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.248219 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.248663 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.249106 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.280334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.281039 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.281471 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.281928 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.objects.instance [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lazy-loading 'fault' on Instance uuid 89a94fad-c4f4-4188-9268-954644d39931 {{(pid=118977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:07:36.327510 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:36.335347 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b33ff2c9-a198-498f-835b-01628da6b08d tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 200 len: 1308 microversion: 2.1 time: 0.101408 Oct 16 01:07:36.335909 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 458/880] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:36 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:37.364997 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:37.366018 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 89a94fad-c4f4-4188-9268-954644d39931] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:37.376531 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:37.377397 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:37.378109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:37.379255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:37.380008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:37.380729 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:37.396751 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] HTTP exception thrown: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Request method failure captured: Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 HTTP/1.1 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1kF812lpYNbk0bLEADj82wpz1hsl11HfAjoaEtvOn5BzqSyR_cQ3FQvTOhonOu4dnf9Gxt18ZFfIjBfLS8yBfGp1M-8aTf9V26XSVxLj8tSo6ahL_C8-v9kLlVtkSPtBh-SvO7nQ7dRkj8j35APbs_ZX2iTVWYxYg4WC4E4mXbaCYQ Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 6eb6fce9d1af4831b9766b5221e83a39 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:07:37.398411 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6eb6fce9d1af4831b9766b5221e83a39", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6eb6fce9d1af4831b9766b5221e83a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6eb6fce9d1af4831b9766b5221e83a39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6eb6fce9d1af4831b9766b5221e83a39"}]}] Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 6eb6fce9d1af4831b9766b5221e83a39 Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesSnapshotTestJSON-1123950910-project Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 91b45f14af1e45a491ceed5b26a353b3 Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesSnapshotTestJSON-1123950910-project Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. Oct 16 01:07:37.399878 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '89a94fad-c4f4-4188-9268-954644d39931'} Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:07:37.400723 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. Oct 16 01:07:37.402605 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:07:37.404097 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Returning 404 to user: Instance 89a94fad-c4f4-4188-9268-954644d39931 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:07:37.404097 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-c0933939-821b-439d-ad86-48d4dd0816e1 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931" status: 404 len: 111 microversion: 2.1 time: 0.042950 Oct 16 01:07:37.404097 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 423/881] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:37 2022] GET /compute/v2.1/servers/89a94fad-c4f4-4188-9268-954644d39931 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:07:41.163451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-644315006", "imageRef": "5def946c-1a1d-4d5b-a9e0-98f4c1266a84", "flavorRef": "452", "networks": [{"uuid": "7ba9d17d-d55a-4345-a42f-fad6849cda16"}]}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:41.220773 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.network.neutron [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] validate_networks() for [('7ba9d17d-d55a-4345-a42f-fad6849cda16', None, None, None, None, None)] {{(pid=118977) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:41.635140 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Flavor limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:07:41.635684 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Image limits 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:07:41.636173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Flavor pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:07:41.636577 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Image pref 0:0:0 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:07:41.637036 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.virt.hardware [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:07:41.646314 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:41.646792 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:41.647221 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:41.647938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:41.648386 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:41.648795 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:41.665498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Getting quotas for project 6eb6fce9d1af4831b9766b5221e83a39. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:41.669987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Getting quotas for user 91b45f14af1e45a491ceed5b26a353b3 and project 6eb6fce9d1af4831b9766b5221e83a39. Resources: {'instances', 'ram', 'cores'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:41.681865 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Going to run 1 instances... {{(pid=118977) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:07:41.684129 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5def946c-1a1d-4d5b-a9e0-98f4c1266a84',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:07:41.733363 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fa45e866-9aa8-4819-a49d-01dca33dd712 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573737 Oct 16 01:07:41.734210 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 459/882] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:07:41.744972 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-595af407-afb1-4d84-b140-46e65204f0a4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:41.745548 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-595af407-afb1-4d84-b140-46e65204f0a4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:41.798676 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-595af407-afb1-4d84-b140-46e65204f0a4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:41.805605 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-595af407-afb1-4d84-b140-46e65204f0a4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1218 microversion: 2.1 time: 0.064537 Oct 16 01:07:41.806202 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 424/883] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:41 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:42.828666 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:42.829302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:42.836297 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.836771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.837231 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.837930 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.838385 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.838849 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.902530 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:42.911102 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-007586fa-9618-4a9e-94f5-a461e628dfe4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1278 microversion: 2.1 time: 0.087144 Oct 16 01:07:42.911732 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 460/884] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:42 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:43.935636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:43.936328 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:43.945204 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.945720 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.946154 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:43.946851 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.947310 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.947732 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.074080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.082640 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9201dc5c-c2fc-431c-9aa4-5577d67f5496 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.151508 Oct 16 01:07:44.083212 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 425/885] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:43 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:44.476453 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a179fb-737a-412c-b35d-9a4f64ac74bb", "tag": "e8318173-8e8d-4ba6-b1ad-98dade710576"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:44.486766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:44.487327 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:44.487846 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.499546 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] Creating event network-changed:e8318173-8e8d-4ba6-b1ad-98dade710576 for instance 85a179fb-737a-412c-b35d-9a4f64ac74bb on hv-cinder-maste Oct 16 01:07:44.504916 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-9cb1731a-7fc8-463e-8fca-b09add215313 req-322a7142-8bc4-4ced-b9d4-aa324283d405 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032344 Oct 16 01:07:44.506146 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 461/886] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:45.106367 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:45.106986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:45.113906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:45.114396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:45.114832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:45.115530 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:45.115986 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:45.116409 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:45.479878 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:45.482286 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:45.489210 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-38a4806c-fdcc-4a25-99fd-336e20123d82 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.386806 Oct 16 01:07:45.489779 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 426/887] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:45 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:46.517766 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:46.518487 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:46.525256 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.525737 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.526175 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.526923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.527390 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.527814 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.660139 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:46.668495 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-04dd9142-19fd-42ff-aa74-cfb364c6403c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.155567 Oct 16 01:07:46.669111 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 462/888] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:46 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:47.692747 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:47.693365 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:47.696169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:47.703347 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:47.703864 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:47.704255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:47.705008 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:47.705462 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:47.705886 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:47.840094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:47.848598 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d65ca233-6fc5-4877-9026-b30ca68aaa8a tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.161008 Oct 16 01:07:47.849201 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 427/889] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:47 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:48.876021 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:48.876880 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:48.880648 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:48.889785 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.890609 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.891438 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.892509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.893299 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.893995 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.901674 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:49.029007 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:49.037015 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-11dc04d6-4fdf-4207-829b-a05c0ba3cccd tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.167771 Oct 16 01:07:49.037583 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 463/890] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:48 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:49.746952 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a179fb-737a-412c-b35d-9a4f64ac74bb", "name": "network-vif-plugged", "status": "completed", "tag": "e8318173-8e8d-4ba6-b1ad-98dade710576"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:49.758714 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.759222 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.759643 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.770979 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] Creating event network-vif-plugged:e8318173-8e8d-4ba6-b1ad-98dade710576 for instance 85a179fb-737a-412c-b35d-9a4f64ac74bb on hv-cinder-maste Oct 16 01:07:49.776138 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-a6061ebf-0fc4-4ea7-aff2-b284c4f6f1f3 req-9c83cdb0-aae0-4d70-a2a5-4119328e293e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Oct 16 01:07:49.776801 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 428/891] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:50.067229 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:50.067817 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:50.074430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.074910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.075348 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.076052 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.076506 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.076964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.207357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:50.215712 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-266b8e40-058b-40b9-b38d-e7f7af5bbee5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.152412 Oct 16 01:07:50.216255 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 464/892] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:50 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:51.245276 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:51.246230 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:51.253587 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.254118 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.254600 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.255394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.255893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.256362 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.390317 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:51.398559 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f93e172b-08e2-448f-b5d0-a0c1c95f2f6f tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1318 microversion: 2.1 time: 0.161006 Oct 16 01:07:51.399120 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 429/893] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:51 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:52.425376 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:52.426425 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:52.430068 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:52.431135 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:52.442209 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.443006 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.443720 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.444907 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.445638 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.446336 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.586607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:52.595240 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-85f9a710-edff-4dc4-98c9-da84a4077eaa tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1507 microversion: 2.1 time: 0.176049 Oct 16 01:07:52.595807 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 465/894] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:52 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:52.617962 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a82708a9-387f-454a-83c3-6bab1f5acca8", "device": "/dev/sdb"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:52.620494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:52.622600 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:52.629697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.630190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.630618 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.631323 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.631774 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.632200 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.911377 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d8fa96cb-9812-4028-ba1d-43d1de4d4da2 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "POST /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297318 Oct 16 01:07:52.911967 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 430/895] 10.222.0.13 () {60 vars in 1323 bytes} [Sun Oct 16 01:07:52 2022] POST /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:55.518413 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a82708a9-387f-454a-83c3-6bab1f5acca8", "create_info": {"type": "qcow2", "new_file": "volume-a82708a9-387f-454a-83c3-6bab1f5acca8.f069f362-6367-4d6c-ba56-fb450d4d987d.vhdx", "snapshot_id": "f069f362-6367-4d6c-ba56-fb450d4d987d"}}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:55.526617 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),63c7287c-89ec-454d-9090-cc6273832929(cell1) {{(pid=118977) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 16 01:07:55.527073 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.527542 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.527972 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.563020 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.563498 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.563941 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.587279 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-f97838e6-0921-4598-b77b-0899d1ede476 req-bc0ad9a4-8285-457c-918d-f3b8f2bede8f admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.124268 Oct 16 01:07:55.587935 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 466/896] 10.222.0.43 () {64 vars in 1326 bytes} [Sun Oct 16 01:07:55 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:07:58.819884 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a82708a9-387f-454a-83c3-6bab1f5acca8", "create_info": {"type": "qcow2", "new_file": "volume-a82708a9-387f-454a-83c3-6bab1f5acca8.75d7c9ed-eec6-4932-827f-1aecdd2a19d7.vhdx", "snapshot_id": "75d7c9ed-eec6-4932-827f-1aecdd2a19d7"}}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:58.823205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.823705 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.824129 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.832539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.833032 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.833456 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.849552 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-a2a6bafb-c2a6-4980-932c-c0e06a5cb076 req-0c8f32a0-f0d6-49df-a1d4-5816d3c61fed admin admin] 10.222.0.43 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.084630 Oct 16 01:07:58.850128 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 431/897] 10.222.0.43 () {64 vars in 1326 bytes} [Sun Oct 16 01:07:58 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:08:01.951381 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.954671 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.955149 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.955578 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.964388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.964940 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.965312 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.978769 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-de5aaa4c-7b82-4a24-94d6-304b6eeb6252 req-56cd8e7a-9f6d-4de7-b2db-1d4ed268af15 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/75d7c9ed-eec6-4932-827f-1aecdd2a19d7?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.75d7c9ed-eec6-4932-827f-1aecdd2a19d7.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.084032 Oct 16 01:08:01.979321 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 467/898] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:08:01 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/75d7c9ed-eec6-4932-827f-1aecdd2a19d7?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.75d7c9ed-eec6-4932-827f-1aecdd2a19d7.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:08:05.071016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=7 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:05.124068 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:05.127298 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.127781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.128208 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.136751 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.137258 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.137684 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.151072 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-2b4239ff-40ec-471b-a28d-700af12ffc32 req-afa1a638-a2f0-4a04-813e-c959e5c624d4 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a79d0326-21ba-45a3-b32f-90a0665f3240?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.a79d0326-21ba-45a3-b32f-90a0665f3240.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.081212 Oct 16 01:08:05.151568 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 432/899] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:08:05 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a79d0326-21ba-45a3-b32f-90a0665f3240?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.a79d0326-21ba-45a3-b32f-90a0665f3240.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:08:09.286904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=7 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:09.337685 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.340938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.341346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.341775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.353254 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.353726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.354155 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.367470 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-c53d145d-9627-41be-a709-40ca31bf4f38 req-5a0c99f4-aa27-480b-b695-c2bc6f83f9c6 admin admin] 10.222.0.43 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f069f362-6367-4d6c-ba56-fb450d4d987d?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.f069f362-6367-4d6c-ba56-fb450d4d987d.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082047 Oct 16 01:08:09.368130 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 468/900] 10.222.0.43 () {62 vars in 1800 bytes} [Sun Oct 16 01:08:09 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f069f362-6367-4d6c-ba56-fb450d4d987d?delete_info=%7B%22file_to_merge%22:%20%22volume-a82708a9-387f-454a-83c3-6bab1f5acca8.f069f362-6367-4d6c-ba56-fb450d4d987d.vhdx%22,%20%22volume_id%22:%20%22a82708a9-387f-454a-83c3-6bab1f5acca8%22%7D => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:08:12.320991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.321559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:12.328521 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.329042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.329488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.330294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.330785 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.331208 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.412753 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lazy-loading 'services' on Instance uuid 85a179fb-737a-412c-b35d-9a4f64ac74bb {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:12.483986 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d92786b8-ee80-4ab7-b21d-06c4947d18f5 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb/os-volume_attachments/a82708a9-387f-454a-83c3-6bab1f5acca8" status: 202 len: 0 microversion: 2.1 time: 0.167961 Oct 16 01:08:12.484652 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 433/901] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:08:12 2022] DELETE /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb/os-volume_attachments/a82708a9-387f-454a-83c3-6bab1f5acca8 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:08:13.615645 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.616193 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.625257 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.625744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.626186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.626881 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.627338 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.627765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.652658 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:08:13.732028 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-68faabd8-ac58-4c9a-8965-2581e821de1c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "DELETE /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 204 len: 0 microversion: 2.1 time: 0.123382 Oct 16 01:08:13.732720 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 469/902] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:08:13 2022] DELETE /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:08:13.742277 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.742974 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.749390 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.749873 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.750304 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.750991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.751457 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.751863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.887256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.895607 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d2e93c21-6062-46be-85ca-d88aecfb58c4 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1513 microversion: 2.1 time: 0.158085 Oct 16 01:08:13.896181 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 434/903] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:13 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:14.922408 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:14.923302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:14.932090 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.932699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.933363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.934278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.934882 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.935451 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.075789 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:15.084009 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-60d5164c-b755-4063-832e-b03a741296dc tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1513 microversion: 2.1 time: 0.167706 Oct 16 01:08:15.084795 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 470/904] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:14 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:16.111614 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:16.112302 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:16.114867 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=4 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:16.120745 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:16.121254 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:16.121691 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:16.122380 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:16.122838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:16.123259 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:16.257935 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:16.266116 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-4450c3a8-849f-4d61-b21b-08cb57189a28 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1513 microversion: 2.1 time: 0.159394 Oct 16 01:08:16.266663 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 435/905] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:16 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:17.293153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:17.294173 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:17.305100 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:17.305910 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:17.306631 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:17.307765 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:17.308520 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:17.309274 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:17.439099 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:17.447167 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-7e0dc33f-f9b9-40a7-9b9a-ab24c223de6c tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1513 microversion: 2.1 time: 0.160532 Oct 16 01:08:17.447736 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 471/906] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:17 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:18.474815 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:18.475771 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:18.485520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.486000 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.486430 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.487120 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.487575 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.487991 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.490539 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:18.623417 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91b45f14af1e45a491ceed5b26a353b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb6fce9d1af4831b9766b5221e83a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.631737 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9bc67b5b-7c68-42c9-964d-2df6a0f93682 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 200 len: 1513 microversion: 2.1 time: 0.163809 Oct 16 01:08:18.632303 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 436/907] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:18 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:18.921944 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a179fb-737a-412c-b35d-9a4f64ac74bb", "name": "network-vif-deleted", "tag": "e8318173-8e8d-4ba6-b1ad-98dade710576"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:18.933315 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.933791 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.934213 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.936938 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:18.947519 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] Creating event network-vif-deleted:e8318173-8e8d-4ba6-b1ad-98dade710576 for instance 85a179fb-737a-412c-b35d-9a4f64ac74bb on hv-cinder-maste Oct 16 01:08:18.953230 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-08bab737-6e3e-4510-9543-c4106c88cfc8 req-3e31d5ce-9a48-436c-aee1-a3ab1646d06c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Oct 16 01:08:18.953829 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 472/908] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:19.657625 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:19.658255 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] [instance: 85a179fb-737a-412c-b35d-9a4f64ac74bb] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:19.665195 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:19.665681 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:19.666113 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:19.666811 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:19.667266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:19.667692 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:19.681258 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] HTTP exception thrown: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Request method failure captured: Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb HTTP/1.1 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1kF812lpYNbk0bLEADj82wpz1hsl11HfAjoaEtvOn5BzqSyR_cQ3FQvTOhonOu4dnf9Gxt18ZFfIjBfLS8yBfGp1M-8aTf9V26XSVxLj8tSo6ahL_C8-v9kLlVtkSPtBh-SvO7nQ7dRkj8j35APbs_ZX2iTVWYxYg4WC4E4mXbaCYQ Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 6eb6fce9d1af4831b9766b5221e83a39 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:08:19.682847 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6eb6fce9d1af4831b9766b5221e83a39", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6eb6fce9d1af4831b9766b5221e83a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6eb6fce9d1af4831b9766b5221e83a39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6eb6fce9d1af4831b9766b5221e83a39"}]}] Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 6eb6fce9d1af4831b9766b5221e83a39 Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1123950910 Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-VolumesSnapshotTestJSON-1123950910-project Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 91b45f14af1e45a491ceed5b26a353b3 Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-VolumesSnapshotTestJSON-1123950910-project Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. Oct 16 01:08:19.684522 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '85a179fb-737a-412c-b35d-9a4f64ac74bb'} Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:19.685562 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. Oct 16 01:08:19.687152 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:08:19.688452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] Returning 404 to user: Instance 85a179fb-737a-412c-b35d-9a4f64ac74bb could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:19.688452 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1a9cf01f-0a6d-49ed-92b4-3ca8f33e4889 tempest-VolumesSnapshotTestJSON-1123950910 tempest-VolumesSnapshotTestJSON-1123950910-project] 10.222.0.13 "GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 16 01:08:19.688452 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 437/909] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:19 2022] GET /compute/v2.1/servers/85a179fb-737a-412c-b35d-9a4f64ac74bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:08:25.048318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=6 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:25.053595 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:25.055871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:25.062869 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.063347 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.063775 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:25.064456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.064929 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.065346 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:25.140422 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c5af2fff-65d3-44d3-8a19-65985a53d1bf tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action" status: 202 len: 0 microversion: 2.1 time: 0.092704 Oct 16 01:08:25.141190 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 473/910] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:08:25 2022] POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:08:25.149294 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:25.150192 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:25.157011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.157487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.157903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:25.158633 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.159079 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.159525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:25.308583 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:25.317004 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8404db56-964f-4738-8f6a-ffa32c2c20b1 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1752 microversion: 2.1 time: 0.171458 Oct 16 01:08:25.317565 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 438/911] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:25 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:26.344894 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:26.345936 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:26.352389 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.352871 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.353334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.354050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.354506 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.354926 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.497811 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:26.506653 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a723a94b-f0f7-4a55-bc06-ac4e43becf97 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.168917 Oct 16 01:08:26.507209 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 474/912] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:26 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:27.534463 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:27.535578 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:27.546538 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:27.547021 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:27.547487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:27.548281 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:27.548748 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:27.549174 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:27.699466 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:27.707851 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-7c074b92-16a7-4d4b-8c0d-8e7e3892a447 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.180116 Oct 16 01:08:27.708409 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 439/913] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:27 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:28.732334 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:28.733102 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:28.753904 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.754469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.754868 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.755685 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.756018 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.756445 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.911746 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:28.920095 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8899bfbb-e79f-46fc-8cfa-d0eb80f40089 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.191695 Oct 16 01:08:28.920653 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 475/914] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:28 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:29.944455 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:29.945252 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:29.951188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:29.951665 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:29.952096 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:29.952781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:29.953251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:29.953745 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:30.105259 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:30.114739 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-5cc7a5fe-5139-43ef-8624-fe4df3d920df tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.174026 Oct 16 01:08:30.115342 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 440/915] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:29 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:31.138195 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:31.138820 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:31.146067 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.146558 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.146991 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.147695 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.148170 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.148594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.302243 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.311614 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ce0549ad-9957-48f6-b704-eb843517ba72 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.177564 Oct 16 01:08:31.312178 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 476/916] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:31 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:32.339640 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:32.340643 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:32.349249 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.349769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:32.350211 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:32.350897 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.351346 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:32.351781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:32.500487 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:32.509187 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-f02a7247-1ad5-49f5-920f-f0357081fe07 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.176730 Oct 16 01:08:32.509750 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 441/917] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:32 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:33.532434 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:33.533097 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:33.539363 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.539862 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.540293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.541013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.541474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.541895 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.685618 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:33.694732 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-3dadb928-a2a1-4a33-b10f-71ec2aa0913b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.166353 Oct 16 01:08:33.695310 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 477/918] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:33 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:34.717713 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:34.718413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:34.725550 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.726042 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.726523 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.727215 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.727663 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.728344 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.874503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:34.883317 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a01ded75-5b02-4a4c-8637-af0b1a82ec30 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.169648 Oct 16 01:08:34.884006 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 442/919] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:34 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:35.909008 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:35.909654 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:35.916659 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:35.917318 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:35.917743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:35.918443 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:35.918900 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:35.919324 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.075247 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.085362 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5fce3458-b9cb-400f-a219-c7c23e32f8b5 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1757 microversion: 2.1 time: 0.180158 Oct 16 01:08:36.085987 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 478/920] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:35 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:37.112331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:37.113006 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:37.115350 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=21 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:37.120746 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.121350 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.121782 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.122582 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.123089 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.123566 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.268266 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:37.277224 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8a3cd913-40ac-42d3-9f58-5395a9ea785f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1760 microversion: 2.1 time: 0.169341 Oct 16 01:08:37.277800 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 443/921] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:37 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:48.546308 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:48.548684 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:48.798778 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c992f819-2dd4-4ba5-9757-55b0502550db tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Action: 'create', calling method: .version_select at 0x7f5806dfc310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1385293807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtu2gS80d46HsBndCKz7a/bLyTIraG3gQEWIK1uOJg4XEuHwfkPrJrjxIHYNuQMffzYNbapaYbCuieVltd/cvpfjjn1za5ocFNeDn7fl8ick6MkMOmDY1ejT2wLzoSiqA=="}} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:48.825560 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-c992f819-2dd4-4ba5-9757-55b0502550db tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Getting quotas for project 0ab987ef18b2446bad98b1cee2631483. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:48.830733 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.quota [None req-c992f819-2dd4-4ba5-9757-55b0502550db tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Getting quotas for user 8e4b9d82feb54094ac30f3acb29c005a and project 0ab987ef18b2446bad98b1cee2631483. Resources: {'key_pairs'} {{(pid=118977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:48.855038 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c992f819-2dd4-4ba5-9757-55b0502550db tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.317455 Oct 16 01:08:48.855643 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 479/922] 10.222.0.13 () {60 vars in 1159 bytes} [Sun Oct 16 01:08:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:07.578308 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1223969522", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1385293807", "security_groups": [{"name": "tempest-secgroup-smoke-1743769040"}], "networks": [{"uuid": "f219700a-39d4-4943-a9ca-dfe6d57ea848"}], "block_device_mapping_v2": [{"uuid": "440492f1-b3ae-4e0a-a3aa-0cdcacdd6094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:07.588994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:07.589648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=43 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:07.700481 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.network.neutron [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] validate_networks() for [('f219700a-39d4-4943-a9ca-dfe6d57ea848', None, None, None, None, None)] {{(pid=118976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:08.393394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Flavor limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:08.393817 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Image limits 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:08.394287 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Flavor pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:08.394735 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Image pref 0:0:0 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:08.395163 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.virt.hardware [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:08.404467 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.404992 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.405436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.406159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.406721 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.407144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.423797 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Getting quotas for project 0ab987ef18b2446bad98b1cee2631483. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:08.427941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.quota [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Getting quotas for user 8e4b9d82feb54094ac30f3acb29c005a and project 0ab987ef18b2446bad98b1cee2631483. Resources: {'instances', 'ram', 'cores'} {{(pid=118976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:08.490926 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Going to run 1 instances... {{(pid=118976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:08.493074 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='440492f1-b3ae-4e0a-a3aa-0cdcacdd6094',volume_size=None,volume_type=None)] {{(pid=118976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:08.629895 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-e4d5f5cb-eab9-481d-b9d4-b4fe28e8469a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.055181 Oct 16 01:09:08.630584 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 444/923] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:09:08.642402 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=4 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:08.643153 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:08.647846 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-14a414cf-e8cf-47bd-8d6f-c27d07944e50 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:08.648455 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-14a414cf-e8cf-47bd-8d6f-c27d07944e50 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:08.704044 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-14a414cf-e8cf-47bd-8d6f-c27d07944e50 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:08.710864 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-14a414cf-e8cf-47bd-8d6f-c27d07944e50 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1089 microversion: 2.1 time: 0.070221 Oct 16 01:09:08.711429 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 480/924] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:08 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:09.734449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:09.735002 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:09.742011 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.742503 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.742941 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.743642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.744098 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.744525 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.809169 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:09.817567 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-eab32aaf-4d94-4cd9-8b6d-a17d1c6e126a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1195 microversion: 2.1 time: 0.087818 Oct 16 01:09:09.818131 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 445/925] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:09 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:10.842321 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:10.842958 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:10.849992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:10.850485 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:10.850909 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:10.851600 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:10.852051 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:10.852469 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:10.984735 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:10.992535 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-c1cb744c-4f1e-462e-9033-3f32df415222 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.154150 Oct 16 01:09:10.993118 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 481/926] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:10 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:11.187642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:11.199328 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.199893 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.200551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.211882 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] Creating event network-changed:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:09:11.217318 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-37c85cc7-be41-45a9-a399-9f9d4a4db44c req-b76d9c64-7b72-4475-8f6e-6c9d59c6f130 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035033 Oct 16 01:09:11.217909 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 446/927] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:12.019677 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:12.020606 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:12.031633 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:12.032117 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:12.032576 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:12.033331 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:12.033774 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:12.034200 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:12.184304 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:12.192436 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-58a826bc-153a-4cf5-b1b7-a6de7881ce9b tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.179637 Oct 16 01:09:12.193037 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 482/928] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:12 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:13.219723 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:13.220918 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:13.232348 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:13.233212 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:13.233930 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:13.235071 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:13.235520 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:13.235936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:13.380648 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:13.392513 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8fc24b14-c0c9-4aad-a709-e85ee3d86b69 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.179669 Oct 16 01:09:13.393415 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 447/929] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:13 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:14.421473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:14.422115 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:14.428657 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:14.429184 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:14.429643 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:14.430360 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:14.430821 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:14.431248 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:14.567994 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:14.576489 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-397a1ec0-7e62-4fcf-b9da-057fdfc114c1 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.159384 Oct 16 01:09:14.577134 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 483/930] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:14 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:15.604065 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.605054 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:15.615920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.616719 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.617486 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.618662 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.619413 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.620105 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.758021 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:15.765772 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-9d9032d9-38df-4277-952f-f768a1407318 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.168636 Oct 16 01:09:15.766360 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 448/931] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:16.788017 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:16.788635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:16.795760 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.796251 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.796686 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:16.797537 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.797992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.798416 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:16.933284 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.941159 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6ff4b3ec-f95a-42ba-8b98-b5d5c2c01cd5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.157048 Oct 16 01:09:16.941701 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 484/932] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:16 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:17.968243 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.969296 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.977154 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.977695 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.978178 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.978932 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.979433 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.979903 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.114551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:18.122963 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a3b5d953-0aae-46c4-b139-26cb4020b6f5 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.161290 Oct 16 01:09:18.123554 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 449/933] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:18.233241 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "name": "network-vif-plugged", "status": "completed", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:18.243046 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.243647 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.244076 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.255176 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] Creating event network-vif-plugged:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:09:18.260209 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-937ca031-c71e-481e-84c0-d4a3969d8161 req-5bdb450f-b59a-48e7-a284-186f609d263c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Oct 16 01:09:18.260801 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 485/934] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:19.148944 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.149965 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.153080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=2 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:19.154161 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell0:SELECT=6 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:19.164094 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.164934 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.165687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.166826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.167585 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.168270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.305667 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.313933 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-bb90fc51-57c9-467e-b763-89c4f56d6c01 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1261 microversion: 2.1 time: 0.171565 Oct 16 01:09:19.314474 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 450/935] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:20.333833 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell0:SELECT=2 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:20.339302 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.340133 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.346956 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.347771 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.348189 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.348970 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.349452 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.349876 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.481387 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.489730 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-5b03c7bb-fd9a-49f4-b522-4a0a344b7a06 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1443 microversion: 2.1 time: 0.157046 Oct 16 01:09:20.490329 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 486/936] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:20.511754 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.512366 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.519085 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.519571 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.520003 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.520697 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.521186 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.521607 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.655556 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.663914 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-829578b9-5414-43b8-bd6a-daa9126462df tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1443 microversion: 2.1 time: 0.156039 Oct 16 01:09:20.664487 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 451/937] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:22.322407 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:22.332390 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.333111 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.333877 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.345210 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] Creating event network-changed:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:09:22.350852 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-2c1db756-bce8-42a6-964e-e06a5c5c9102 req-b040aca5-d7e7-4fe7-b532-52158676ec42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032238 Oct 16 01:09:22.351631 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 487/938] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:40.683494 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1195464529"}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:40.684407 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:40.687765 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:40.688778 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=40 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:40.697739 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.698271 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.698835 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.699802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.700428 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.701014 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.842061 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.network.security_group_api [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Removing security group bc6ffcb3-709f-4eb6-b49b-538b7947f91f from port 55069e9b-0f47-4ba8-afa4-a1a621b342ed Oct 16 01:09:41.153103 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-8b01f7a4-0cb8-4102-a18a-85c3684c73e6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action" status: 202 len: 0 microversion: 2.1 time: 0.475650 Oct 16 01:09:41.153733 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 452/939] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:40 2022] POST /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:09:41.162915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:41.169448 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=18 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:41.170228 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=34 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:41.175178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:41.175178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:41.175532 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:41.193498 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] Creating event network-changed:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:09:41.198512 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-35a490cb-5898-4c89-8ce4-f559c8477e34 req-f220a74e-46b7-45ee-b47d-228cbed724b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039803 Oct 16 01:09:41.199115 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 488/940] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:42.456635 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:42.457190 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:42.463594 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.464205 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.464687 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.465449 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.465906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.466342 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.549931 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lazy-loading 'services' on Instance uuid f12459d2-6c23-4fe4-9d29-0d66700864de {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:42.625563 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b929c93a-7a50-4b54-a23b-19c6d9753513 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments/cb5a1415-4c1a-4258-9edf-5ed281591043" status: 202 len: 0 microversion: 2.1 time: 0.173395 Oct 16 01:09:42.626299 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 453/941] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:09:42 2022] DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments/cb5a1415-4c1a-4258-9edf-5ed281591043 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:09:42.638092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:42.640824 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:42.649489 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.649881 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.650298 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.650993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.651447 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.651866 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.684803 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-fff1ed4b-b0d7-42c5-8aaa-d63f744b46d8 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052740 Oct 16 01:09:42.685412 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 489/942] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:42 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:43.217396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:43.228866 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.229357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.229781 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.241885 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] Creating event network-changed:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:09:43.246929 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-2a1c27e4-cb3a-470c-a131-dd173fbbe843 req-0db084ca-acc0-4888-a46e-3f659e678474 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Oct 16 01:09:43.247522 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 454/943] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:43.698059 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.700382 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.707092 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.707580 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.708011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.708699 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.709207 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.709626 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.738838 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-eb9c4f78-6127-4782-8170-f1c4d52a507f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044809 Oct 16 01:09:43.739404 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 490/944] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:43 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:09:43.751378 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.751936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.758151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.758628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.759056 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.759737 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.760185 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.760601 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.835961 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] HTTP exception thrown: Instance f12459d2-6c23-4fe4-9d29-0d66700864de is not attached to volume cb5a1415-4c1a-4258-9edf-5ed281591043 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Request method failure captured: Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments/cb5a1415-4c1a-4258-9edf-5ed281591043 HTTP/1.1 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1kYzGoLS1z6NZUlpO-7MaOEC3WK1NwC5_Bi5q7K72ln1qQ_F7QEIzHi6BE6yZn_q0p9BQuIualDiOyRzwj4F0icce7PH9Q03ikXRWZxH98hr-HLY1QVfDj0XuUglfJdMmCLXDdsNpdFZQsA1gLgNMmcPwjL0n1VuJPi020_J4J3ydc Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 7f2d2934c1834e02a6568c67cea56be5 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:09:43.838420 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f2d2934c1834e02a6568c67cea56be5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f2d2934c1834e02a6568c67cea56be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f2d2934c1834e02a6568c67cea56be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f2d2934c1834e02a6568c67cea56be5"}]}] Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 7f2d2934c1834e02a6568c67cea56be5 Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-TestMinimumBasicScenario-318570247-project Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 0ba011221c4d4f5aa17d63bec4762c42 Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-TestMinimumBasicScenario-318570247-project Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:09:43.840003 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance f12459d2-6c23-4fe4-9d29-0d66700864de is not attached to volume cb5a1415-4c1a-4258-9edf-5ed281591043 Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'server_id': 'f12459d2-6c23-4fe4-9d29-0d66700864de', 'id': 'cb5a1415-4c1a-4258-9edf-5ed281591043'} Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb5a1415-4c1a-4258-9edf-5ed281591043. Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:43.840925 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12459d2-6c23-4fe4-9d29-0d66700864de is not attached to volume cb5a1415-4c1a-4258-9edf-5ed281591043 Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12459d2-6c23-4fe4-9d29-0d66700864de is not attached to volume cb5a1415-4c1a-4258-9edf-5ed281591043 Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.842432 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Returning 404 to user: Instance f12459d2-6c23-4fe4-9d29-0d66700864de is not attached to volume cb5a1415-4c1a-4258-9edf-5ed281591043 {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:43.843581 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a2ae2dcb-b311-4628-84bc-6cfa1b71865a tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments/cb5a1415-4c1a-4258-9edf-5ed281591043" status: 404 len: 154 microversion: 2.1 time: 0.093446 Oct 16 01:09:43.843581 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 455/945] 10.222.0.13 () {58 vars in 1416 bytes} [Sun Oct 16 01:09:43 2022] DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de/os-volume_attachments/cb5a1415-4c1a-4258-9edf-5ed281591043 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:09:44.992672 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:44.993230 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.000255 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.001012 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.001366 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.002061 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.002515 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.002943 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.027834 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:45.111842 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-41fd0ec6-d1fc-43c1-bb3b-205ecbfd2b89 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 204 len: 0 microversion: 2.1 time: 0.122940 Oct 16 01:09:45.112600 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 491/946] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:44 2022] DELETE /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:45.121144 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:45.121762 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.128256 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.128741 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.129199 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.129880 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.130331 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.130769 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.274622 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.286433 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-3342bae8-427a-44ca-8e37-9af491a73c4b tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1554 microversion: 2.1 time: 0.169046 Oct 16 01:09:45.287209 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 456/947] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:45 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:46.317194 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:46.317924 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:46.327384 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.327873 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.328357 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.329298 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.329726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.330176 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.471767 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:46.479978 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-b315823e-123b-46ef-87eb-7063430d996f tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1554 microversion: 2.1 time: 0.169271 Oct 16 01:09:46.480519 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 492/948] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:46 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:47.503551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:47.504300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:47.511097 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.511553 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.511981 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.512675 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.513159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.513994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.658260 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba011221c4d4f5aa17d63bec4762c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f2d2934c1834e02a6568c67cea56be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:47.662582 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12459d2-6c23-4fe4-9d29-0d66700864de", "name": "network-vif-deleted", "tag": "55069e9b-0f47-4ba8-afa4-a1a621b342ed"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:47.669199 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-ddb5a4f1-9ef6-4fd6-b71b-c20d011ccfcb tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 200 len: 1554 microversion: 2.1 time: 0.169393 Oct 16 01:09:47.670179 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 457/949] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:47 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:47.673182 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.673662 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.674093 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.685746 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] Creating event network-vif-deleted:55069e9b-0f47-4ba8-afa4-a1a621b342ed for instance f12459d2-6c23-4fe4-9d29-0d66700864de on hv-cinder-maste Oct 16 01:09:47.690634 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-0581eab1-a4d8-412e-a29b-9ccadf3656a5 req-79d22986-e154-49e5-9deb-0e8a51f210aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031803 Oct 16 01:09:47.691288 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 493/950] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:48.695628 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.696394 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] [instance: f12459d2-6c23-4fe4-9d29-0d66700864de] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:48.705270 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.705888 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.706477 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.707377 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.707984 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.708545 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.725144 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] HTTP exception thrown: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Request method failure captured: Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de HTTP/1.1 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1kYzGoLS1z6NZUlpO-7MaOEC3WK1NwC5_Bi5q7K72ln1qQ_F7QEIzHi6BE6yZn_q0p9BQuIualDiOyRzwj4F0icce7PH9Q03ikXRWZxH98hr-HLY1QVfDj0XuUglfJdMmCLXDdsNpdFZQsA1gLgNMmcPwjL0n1VuJPi020_J4J3ydc Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 7f2d2934c1834e02a6568c67cea56be5 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:09:48.726692 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f2d2934c1834e02a6568c67cea56be5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f2d2934c1834e02a6568c67cea56be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f2d2934c1834e02a6568c67cea56be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f2d2934c1834e02a6568c67cea56be5"}]}] Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 7f2d2934c1834e02a6568c67cea56be5 Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-TestMinimumBasicScenario-318570247 Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-TestMinimumBasicScenario-318570247-project Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 0ba011221c4d4f5aa17d63bec4762c42 Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-TestMinimumBasicScenario-318570247-project Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. Oct 16 01:09:48.728186 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': 'f12459d2-6c23-4fe4-9d29-0d66700864de'} Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:48.729231 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. Oct 16 01:09:48.730766 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:09:48.732166 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Returning 404 to user: Instance f12459d2-6c23-4fe4-9d29-0d66700864de could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:48.732166 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1e327bb7-3410-4a5a-88b0-ad9a13615039 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de" status: 404 len: 111 microversion: 2.1 time: 0.037711 Oct 16 01:09:48.732166 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 458/951] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:48 2022] GET /compute/v2.1/servers/f12459d2-6c23-4fe4-9d29-0d66700864de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:48.737762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-4812b31a-02fc-404a-8458-39e04d8705d6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] Calling method '.version_select at 0x7f5806dfce50>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.758617 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-4812b31a-02fc-404a-8458-39e04d8705d6 tempest-TestMinimumBasicScenario-318570247 tempest-TestMinimumBasicScenario-318570247-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170547242" status: 202 len: 0 microversion: 2.1 time: 0.025505 Oct 16 01:09:48.759178 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 494/952] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 16 01:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170547242 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:40.516083 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:11:40.516663 dv-cinder-master-3-smb devstack@n-api.service[118976]: Sun Oct 16 01:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action (ip 10.222.0.13) !!! Oct 16 01:11:40.517283 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=14 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:40.518053 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:40.519184 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 16 01:11:40.519349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Sun Oct 16 01:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action (ip 10.222.0.13) !!! Oct 16 01:11:40.524188 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:40.524721 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:40.535159 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.535638 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.536069 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.536770 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.537247 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.537668 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.562041 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.objects.instance [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lazy-loading 'flavor' on Instance uuid 26fb7f70-27c8-4572-aa0c-57e1750aca98 {{(pid=118976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:40.638591 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2c4a3e7a-fdd2-4794-8729-ae479874da93 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "POST /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action" status: 202 len: 0 microversion: 2.1 time: 0.124461 Oct 16 01:11:40.639174 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 459/953] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:11:40 2022] POST /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:40.644977 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:11:40.645711 dv-cinder-master-3-smb devstack@n-api.service[118977]: Sun Oct 16 01:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 (ip 10.222.0.13) !!! Oct 16 01:11:40.647762 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:40.648499 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:40.653685 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:40.654410 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:40.664992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.665476 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.665913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.666611 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.667063 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.667466 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.019931 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.028298 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-8f7d2130-f760-4f2b-a81f-f699743cc129 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.384718 Oct 16 01:11:41.028866 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 495/954] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:40 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:42.057146 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:42.057913 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:42.065826 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.066355 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.066838 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.067605 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.068109 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.068565 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.262216 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.270275 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b960a306-82df-45a2-a2ea-671d26a363ec tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.221221 Oct 16 01:11:42.270860 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 460/955] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:43.298922 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.299889 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.310783 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.311601 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.312293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.313473 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.314234 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.314923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.466413 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.474527 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-cfceca15-5bda-43b6-8c0d-ecea33e7c68a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.182040 Oct 16 01:11:43.475093 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 496/956] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:43 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:44.500332 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:44.500963 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:44.507957 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.508444 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.508865 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.509608 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.510072 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.510496 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.643415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.651384 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1c926c17-10c0-4b4b-a3c9-81a08ac009e8 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.155111 Oct 16 01:11:44.651948 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 461/957] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:44 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:45.678993 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.679987 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.690843 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.691644 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.692364 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.693548 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.694311 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.695013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.834181 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:45.842512 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-75c2d4ac-eb62-441e-b713-53ad2f8075eb tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.170076 Oct 16 01:11:45.843094 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 497/958] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:46.870388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:46.871301 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:46.882285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.883080 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.883792 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.884921 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.885700 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.886405 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.026125 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:47.034014 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-681e8096-4bad-40b9-b05f-bb04908c246c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.170311 Oct 16 01:11:47.034578 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 462/959] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:46 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:48.061373 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:48.062218 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:48.069594 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.070103 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.070555 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.071278 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.071743 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.072186 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.207224 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.215435 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-77e50f75-be86-48b2-8bf9-cbd67230b950 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.160625 Oct 16 01:11:48.216018 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 498/960] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:49.243389 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.244436 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:49.255485 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.256290 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.257156 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.258282 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.259038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.259734 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.404217 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.412569 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d10f3324-98b9-4033-ba1e-ccb36050a266 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.175722 Oct 16 01:11:49.413216 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 463/961] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:50.439798 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:50.440472 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:50.448812 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.449509 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.450050 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.450913 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.451482 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.451992 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.591286 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:50.604294 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-49385fa0-ce4b-495b-98db-56339ce2fb25 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.170621 Oct 16 01:11:50.605118 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 499/962] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:50 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:51.633987 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:51.634994 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:51.646508 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.647278 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.647961 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.649187 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.649954 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.650658 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.790728 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.802753 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-6b9be7fd-4972-4410-a3c5-adfad4c67467 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.175242 Oct 16 01:11:51.803579 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 464/963] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:51 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:52.834107 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:52.835178 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:52.846244 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.847041 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.847751 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.848933 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.849687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.850678 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.986776 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:52.994722 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-52d08638-150b-4e59-aac2-5e57e7fce94a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.167510 Oct 16 01:11:52.995282 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 500/964] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:52 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:54.023680 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:54.024602 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.035306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.035787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.036220 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.036906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.037386 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.037802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.175906 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.184335 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-a2d1f043-efb0-4409-bc1d-ce586d7654a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1509 microversion: 2.1 time: 0.167318 Oct 16 01:11:54.184960 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 465/965] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:54 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:54.206726 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:54.207272 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.213965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.214456 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.214878 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.215562 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.216011 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.216426 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.244687 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118977) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:11:54.315405 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-a390ce82-01b1-454d-9b06-901d71e42f1a tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "POST /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action" status: 202 len: 0 microversion: 2.1 time: 0.112641 Oct 16 01:11:54.315919 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 501/966] 10.222.0.13 () {60 vars in 1278 bytes} [Sun Oct 16 01:11:54 2022] POST /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:54.324067 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:54.324684 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.331044 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.331580 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.332014 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.332716 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.333229 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.333642 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.497716 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.506017 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-897cff42-f88c-4afe-b3da-4b168deffd59 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1517 microversion: 2.1 time: 0.185818 Oct 16 01:11:54.506800 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 466/967] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:54 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:54.995474 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "name": "network-vif-unplugged", "status": "completed", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:55.007788 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.008392 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.008948 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.021198 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.compute.server_external_events [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] Unable to find a host for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98. Dropping event network-vif-unplugged {{(pid=118977) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 01:11:55.022283 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-5be4e6b9-8ad0-4094-9db1-72c556cc97e0 req-6055c793-eded-459e-85d6-bbfddd4a0700 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032130 Oct 16 01:11:55.022964 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 502/968] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 16 01:11:55.528778 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:55.529423 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:55.535890 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.536371 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.536804 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.537551 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.538004 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.538448 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.671176 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:55.679307 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-32049ef3-1f5c-4522-abd8-a4c8a28be08c tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1519 microversion: 2.1 time: 0.154327 Oct 16 01:11:55.679844 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 467/969] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:55 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:56.706786 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:56.707435 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:56.715374 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.715929 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.716429 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.717270 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.717806 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.718293 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.850087 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.858211 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-35652913-cacf-4850-a536-effe16547982 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.157967 Oct 16 01:11:56.858811 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 503/970] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:56 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:57.886832 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:57.887823 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:57.896787 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.897300 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.897731 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:57.898415 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.898863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.899284 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.033630 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.042099 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-2fe13cd3-7809-47df-aa34-48feb426a841 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.162070 Oct 16 01:11:58.042698 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 468/971] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:57 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:59.068109 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:59.068756 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:59.075899 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:59.076412 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:59.077013 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:59.077732 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:59.078210 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:59.078649 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:59.209551 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:59.217631 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-49afe90e-b03c-43dd-920c-55ddca447c28 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.153469 Oct 16 01:11:59.218173 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 504/972] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:59 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:00.245306 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:00.246293 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:00.256448 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.257297 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.258016 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.259151 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.259920 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.260626 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.401275 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:00.413493 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-57736f09-2953-48fd-af1f-edb1ab2a9170 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.174688 Oct 16 01:12:00.414356 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 469/973] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:00 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:01.067705 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "name": "network-vif-plugged", "status": "completed", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:01.079053 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.079526 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.080152 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.098227 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] Creating event network-vif-plugged:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:12:01.103755 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-cc3466d6-a80c-4375-9ba1-6c7fe9269189 req-f3ef7bdf-4d67-4dc6-a978-16296ede63d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039927 Oct 16 01:12:01.104352 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 505/974] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:01.441435 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:01.442066 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:01.448597 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.449213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.449649 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.450376 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.450831 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.451357 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.592488 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:01.601236 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-39a652bc-aba5-4f8e-b56a-6fef94c5bfea tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.164750 Oct 16 01:12:01.601834 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 470/975] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:01 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:02.630655 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:02.631803 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:02.642323 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.643119 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.643965 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.644659 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.645142 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.645563 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.779964 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:02.788136 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-2552221b-2b82-4579-8b42-76fb778190e4 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1575 microversion: 2.1 time: 0.165304 Oct 16 01:12:02.788719 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 506/976] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:02 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:03.815135 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:03.816073 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:03.824155 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.824734 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.825289 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.826097 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.826639 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.827143 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.970681 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:03.983241 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-44f44c82-2c98-45b1-99d5-20d1b4556830 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1562 microversion: 2.1 time: 0.174385 Oct 16 01:12:03.984078 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 471/977] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:03 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:40.534274 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_api:SELECT=26 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.534915 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:40.535518 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:40.535693 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG dbcounter [-] [118976] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.543559 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.544541 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG dbcounter [-] [118977] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.545677 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:13:40.545851 dv-cinder-master-3-smb devstack@n-api.service[118977]: Sun Oct 16 01:13:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 (ip 10.222.0.13) !!! Oct 16 01:13:40.550103 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.550430 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.551066 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.551772 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.552268 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.552635 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.590556 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Going to try to terminate instance {{(pid=118977) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:13:40.621802 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:40.631636 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.632250 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.632745 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.644186 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.compute.server_external_events [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] Creating event network-changed:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:13:40.649669 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [req-f2316672-13dc-4a8e-81ef-84300ac68320 req-8c4728b0-e973-4e6d-9d0d-319937da7550 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117258 Oct 16 01:13:40.650347 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 472/978] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:13:40.673659 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-6c3e4c9c-5d7d-47d9-9338-a7870d57bca7 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "DELETE /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 204 len: 0 microversion: 2.1 time: 0.143346 Oct 16 01:13:40.674344 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 507/979] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:40 2022] DELETE /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:13:40.683388 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:40.684153 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:40.690712 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.690830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.691248 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.692285 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.693029 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.693528 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.829396 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.837445 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-d6ad34bd-114a-4ec2-975f-a62832d79489 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.158655 Oct 16 01:13:40.838028 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 473/980] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:40 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:41.861923 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:41.862517 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.compute.api [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118977) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:41.869481 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:41.869958 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:41.870388 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:41.871128 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:41.871582 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:41.872002 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:42.008216 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.policy [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118977) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:42.016400 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-d8f7696c-be5d-4333-84fd-33d65292a2a2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1568 microversion: 2.1 time: 0.158756 Oct 16 01:13:42.017079 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 508/981] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:41 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:43.039650 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:43.040213 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:43.046936 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.047452 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.047863 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.048559 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.049062 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.049479 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.180830 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.policy [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e4b9d82feb54094ac30f3acb29c005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab987ef18b2446bad98b1cee2631483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118976) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:43.191134 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-1f27c27b-d0a7-4228-92de-2236fd31ad5d tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 200 len: 1449 microversion: 2.1 time: 0.155270 Oct 16 01:13:43.192897 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 474/982] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:43 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:43.292607 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fb7f70-27c8-4572-aa0c-57e1750aca98", "name": "network-vif-deleted", "tag": "30e10f94-4e60-4726-b0bb-4e41e72923d9"}]} {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:43.302259 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.302744 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.303177 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG oslo_concurrency.lockutils [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.314072 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.compute.server_external_events [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] Creating event network-vif-deleted:30e10f94-4e60-4726-b0bb-4e41e72923d9 for instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 on hv-cinder-maste Oct 16 01:13:43.318806 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [req-3144bbb9-a38a-4cf0-bc76-0f21a4f994fd req-72fdb240-161c-4b55-a414-5bed54fe2328 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093738 Oct 16 01:13:43.319384 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 509/983] 10.222.0.13 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:44.218657 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '>' {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:44.219489 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.compute.api [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] [instance: 26fb7f70-27c8-4572-aa0c-57e1750aca98] Fetching instance by UUID {{(pid=118976) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:44.230529 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:44.231339 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:44.232038 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:44.233251 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Acquiring lock "63c7287c-89ec-454d-9090-cc6273832929" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:44.234005 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:44.234703 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG oslo_concurrency.lockutils [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Lock "63c7287c-89ec-454d-9090-cc6273832929" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:44.252685 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.wsgi [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] HTTP exception thrown: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Request method failure captured: Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: request: GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 HTTP/1.1 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept: application/json Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Accept-Encoding: identity Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Connection: close Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Length: 0 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Content-Type: application/json Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Host: 10.222.0.13 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: Openstack-System-Scope: None Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Auth-Token: gAAAAABjS1mb8Bt9rdnHNF-Zg4g3lAg77riKs2YYFMVPTEEpGpZOH5zMniYG29w_GArQkciG0gbU2KEVXmNascU3oAL9eWv9lGEIhgZE4kv20bfgBWLzBc04G790VFeeZdpXMLMQMaz3jUtSAYvBRxL0tbkhElQRxFPpED1m82pHt3k-LTnTpb4 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Id: None Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Domain-Name: None Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Identity-Status: Confirmed Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Is-Admin-Project: True Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Id: default Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Domain-Name: Default Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Id: 0ab987ef18b2446bad98b1cee2631483 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Project-Name: tempest-TestShelveInstance-1917823397 Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Role: member,reader Oct 16 01:13:44.254349 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Roles: member,reader Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0ab987ef18b2446bad98b1cee2631483", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ab987ef18b2446bad98b1cee2631483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ab987ef18b2446bad98b1cee2631483"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0ab987ef18b2446bad98b1cee2631483"}]}] Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant: tempest-TestShelveInstance-1917823397 Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Id: 0ab987ef18b2446bad98b1cee2631483 Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-Tenant-Name: tempest-TestShelveInstance-1917823397 Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User: tempest-TestShelveInstance-1917823397-project Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Id: default Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Domain-Name: Default Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Id: 8e4b9d82feb54094ac30f3acb29c005a Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: X-User-Name: tempest-TestShelveInstance-1917823397-project Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: method: > Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: exception: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. Oct 16 01:13:44.255997 dv-cinder-master-3-smb devstack@n-api.service[118976]: action_args: {'id': '26fb7f70-27c8-4572-aa0c-57e1750aca98'} Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: {{(pid=118976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:44.257112 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. Oct 16 01:13:44.258668 dv-cinder-master-3-smb devstack@n-api.service[118976]: ERROR nova.api.openstack.wsgi Oct 16 01:13:44.260034 dv-cinder-master-3-smb devstack@n-api.service[118976]: DEBUG nova.api.openstack.wsgi [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Returning 404 to user: Instance 26fb7f70-27c8-4572-aa0c-57e1750aca98 could not be found. {{(pid=118976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:44.260034 dv-cinder-master-3-smb devstack@n-api.service[118976]: INFO nova.api.openstack.requestlog [None req-b70d7a7f-fcc2-4115-be9f-3b593e1e9ed2 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98" status: 404 len: 111 microversion: 2.1 time: 0.043815 Oct 16 01:13:44.260034 dv-cinder-master-3-smb devstack@n-api.service[118976]: [pid: 118976|app: 0|req: 475/984] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:44 2022] GET /compute/v2.1/servers/26fb7f70-27c8-4572-aa0c-57e1750aca98 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:44.425348 dv-cinder-master-3-smb devstack@n-api.service[118977]: DEBUG nova.api.openstack.wsgi [None req-ed3a7fc6-f0cc-45a8-b57d-22cbf64b8822 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] Calling method '.version_select at 0x7f5806e90700>' {{(pid=118977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:44.450933 dv-cinder-master-3-smb devstack@n-api.service[118977]: INFO nova.api.openstack.requestlog [None req-ed3a7fc6-f0cc-45a8-b57d-22cbf64b8822 tempest-TestShelveInstance-1917823397 tempest-TestShelveInstance-1917823397-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1385293807" status: 202 len: 0 microversion: 2.1 time: 0.030189 Oct 16 01:13:44.451459 dv-cinder-master-3-smb devstack@n-api.service[118977]: [pid: 118977|app: 0|req: 510/985] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 16 01:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1385293807 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)